Senior Scraping Engineer

Remote
Posted 9 luni ago

Senior Scraping Engineer

Our client is looking for travel lovers, innovators, and genuinely amazing people who can help them in their mission to make guest communication and feedback simpler and more productive.

 

What is our client searching for?

  • Fluent communication skills in English
  • Fluency in Python 3
  • 3+ years experience developing Spiders
  • Experience working with legacy code
  • Experience with SQL and relational Databases
  • Good understanding of different anti-crawling strategies and how to avoid them

 

Responsibilities:

  • you will collaborate in technical design, implementation, and maintenance of data extractors (spiders)
  • you will design and implement new solutions for improving the spiders’ performance and quality assurance

Nice to have:

  • experience getting data from APPs by means of reverse engineering
  • experience crawling websites with dynamic content (JavaScript)
  • familiar with virtualization technologies, such as Docker
  • experience with agile development practices such as CI, CD, TDD, Pair-programming, Refactoring, etc.
  • experience in frameworks such as Luigi/ Airflow is a plus
  • experience with big data technologies like Hadoop MR, Apache Spark, Kafka, PostgreSQL

What’s in it for you?

  • flexible working hours
  • remote-friendly environment
  • 1 bonus vacation day to be used for your favorite travel adventure!
  • free access to various learning resources, as well as 96 hours/year to be used for learning & development
  • a global team of friendly, highly motivated co-workers
  • English and/or German language lessons
  • other team events and perks based on location

Our client is ready to trust you with successful, long-term collaboration. What about you?

Connect with us at office@itswise.ro and let’s talk about your next opportunity!