FreeCodeCamp/YouCanDoThis

[ELIXIR QUESTION]

Hey Guys I Need Some Help. I wrote a Script for WebScrap

The source :

defmodule Shopee do
  @behaviour Crawly.Spider

  @doc """
  Execute by
  Crawly.Engine.start_spider({defmodule_name})
  """

  @impl Crawly.Spider
  def base_url() do
    "https://shopee.com.my"
  end

  @impl Crawly.Spider
  def init() do
    [start_urls: ["https://shopee.com.my/search?keyword=computer"]]
  end

  @impl Crawly.Spider
  def parse_item(response) do
    urls =
      response.body
      |> Floki.find(".a._35LNwy")
      |> Floki.attribute("href")

    requests =
      Enum.map(urls, fn url ->
        url
        |> build_absolute_url(response.request_url)
        |> Crawly.Utils.request_from_url()
      end)

    name =
      response.body
      |> Floki.find("._1POlWt")
      |> Floki.text()

    price =
      response.body
      |> Floki.find("._5W0f35")
      |> Floki.text(deep: false, sep: "")

    %Crawly.ParsedItem {
      :requests => requests,
      :items => [
        %{name: name, price: price}
      ]
    }

  end

  def build_absolute_url(url, request_url) do
    URI.merge(request_url, url) |> to_string()
  end

  def show() do
    case HTTPoison.get("https://shopee.com.my/search?keyword=computer") do
      {:ok, %HTTPoison.Response{status_code: 200, body: body}} ->
        urls =
          body
          |> Floki.find(".a._35LNwy")
          |> Floki.attribute("href")

          IO.puts urls |> to_string()

          {:ok, urls}

    end
  end
end

The Error I got :

iex(1)> Crawly.Engine.start_spider(Shopee) 

01:32:49.699 [error] GenServer #PID<0.408.0> terminating
** (UndefinedFunctionError) function Shopee.init/1 is undefined or private
    (shopee 0.1.0) Shopee.init([crawl_id: "8ed539e0-bf11-11eb-86f5-3085a98593d6"])
    (crawly 0.13.0) lib/crawly/manager.ex:126: Crawly.Manager.handle_continue/2
    (stdlib 3.8) gen_server.erl:637: :gen_server.try_dispatch/4
    (stdlib 3.8) gen_server.erl:388: :gen_server.loop/7
........

IT 's OK , I fixed it.

instead of @behaviour I declared it use and

I init the function with an ignore expression in the parametre. So is

 @impl Crawly.Spider
  def init(_) do
    [start_urls: ["https://shopee.com.my/search?keyword=computer"]]
  end

instead of

 @impl Crawly.Spider
  def init() do
    [start_urls: ["https://shopee.com.my/search?keyword=computer"]]
  end