Code

SERP (MVP)#62

Code

Merged

Gallaecio merged 20 commits intozytedata:mainzytedata/zyte-spider-templates:mainfrom Gallaecio:serp-mvpGallaecio/zyte-spider-templates:serp-mvpCopy head branch name to clipboardSep 17, 2024

+951-192

Commits

Commits on Aug 27, 2024

• SERP (MVP)

  Gallaecio

  committed
  d785a2d

  Copy full SHA for d785a2d

• Fix references and complete the docs

  Gallaecio

  committed
  4c47efc

  Copy full SHA for 4c47efc

Commits on Aug 28, 2024

• Customize UI strings for SERP and add tests

  Gallaecio

  committed
  d10d75e

  Copy full SHA for d10d75e

• Fix requests mocking

  Gallaecio

  committed
  ff97f07

  Copy full SHA for ff97f07

Commits on Aug 29, 2024

• Enable the aggressive retry policy by default for the SERP spider

  Gallaecio

  committed
  3a44330

  Copy full SHA for 3a44330

Commits on Sep 4, 2024

• Merge remote-tracking branch 'zytedata/main' into serp-mvp

  Gallaecio

  committed
  efc6e83

  Copy full SHA for efc6e83

• Make the SERP spider more Google-specific, in line with the current actual implementation

  Gallaecio

  committed
  1bc4a29

  Copy full SHA for 1bc4a29

• Add a mandatory search keywords field, and set a default input URL

  Gallaecio

  committed
  8f3ab3e

  Copy full SHA for 8f3ab3e

• Improve the SERP implementation, get all tests to pass

  Gallaecio

  committed
  b0786e6

  Copy full SHA for b0786e6

Commits on Sep 9, 2024

• Use a domain drop-down list

  Gallaecio

  committed
  bcf5566

  Copy full SHA for bcf5566

• Improve the search_keywords tooltip and update tests

  Gallaecio

  committed
  89c1b7f

  Copy full SHA for 89c1b7f

• search keywords → search queries

  Gallaecio

  committed
  c3a2f23

  Copy full SHA for c3a2f23

• Fix metadata JSON schema comparison

  Gallaecio

  committed
  25d4cf7

  Copy full SHA for 25d4cf7

• Min zyte-common-items: 0.13.0 → 0.22.0

  Gallaecio

  committed
  d8fe94c

  Copy full SHA for d8fe94c

Commits on Sep 10, 2024

• Remove potentially confusing search keyword references

  Gallaecio

  committed
  b94b7b4

  Copy full SHA for b94b7b4

Commits on Sep 16, 2024

• Make crawl logging more flexible for new page types

  Gallaecio

  committed
  d7b724a

  Copy full SHA for d7b724a

• Update test expectations

  Gallaecio

  committed
  a9d5588

  Copy full SHA for a9d5588

Commits on Sep 17, 2024

• Apply feedback

  Gallaecio

  committed
  7aa70b2

  Copy full SHA for 7aa70b2

• Release notes for 0.9.0

  Gallaecio

  committed
  916b58c

  Copy full SHA for 916b58c

• Remove valid_page_types

  Gallaecio

  committed
  5c5502e

  Copy full SHA for 5c5502e