We are currently hiring a Lead Data Engineer (Data Mining, Web Scrapping) for a Dutch company with over 10 years as a leader in the Data Analytics industry and a proud owner of 2018 Market Research Society award for innovation. The company helps business leaders (companies and consultancy firms in Western Europe, North America, Asia and the Middle East) with decision support solutions that deliver insights into growth opportunities, profitability, sales maximization. They have solid experience in customer research and quantitative analytical capabilities that create deep understanding in customer, competitor and market behavior. Headquartered in Amsterdam, with an office in UK as well, the company help clients make informed decisions based on deep analyses and forecasts. With experts in survey scripting, data processing and text coding they combine market research, data science, behavioral economics, machine learning and advanced analytics to predict customer behavior.

Position Details

Your work will be:

  • Manage the creation process of web crawling tools, services and workflow and improve scrape analysis, reports and data management;
  • Be responsible for a team that writes scrapers (calling APIs) for different websites and fetches appropriate data at regular intervals, extracts and ingests data from websites using web crawling tools;
  • Test the data and the scrape to ensure accuracy and quality;
  • Define and plan the data consistency;
  • Finding innovative ways to get data across multiple sources;
  • Own the process of identifying and fixing any issues with breaks as well as scale scrapes;
  • Communication with clients (act as a consultant), understand and meet their expectations, transfer the proper steps for project implementation to the respective team(s);
  • Support business decisions;
  • Lead and mentor team members.

You need:

  • Experience in web data extraction, building scalable scraping technologies;
  • Knowledge in any of the scripting languages – Python, Bash, Shell, JavaScript, Perl, PHP;
  • Knowledge in Linux/UNIX;
  • Knowledge in Networking;
  • Familiarity with techniques and tools for crawling, extracting and processing data (Scrappy, Pandas, Mapreduce, SQL, BeautifulSoup, etc.);
  • To be organized, initiative and an impressive communicator;
  • Managerial experience – strong mentoring and influencing skills;
  • Fluent in English;
  • As advantages will be considered:
    • Knowledge of HTML, HTTP;
    • Experience with system monitoring tools;
    • Experience with Git, open source practices and code review;
    • Experience with applications designed to display archives web content;
    • Bachelor’s degree in Computer Science or equivalent demonstrated experience.

The offer:

  • 20-25 days paid vacation;
  • Sport package;
  • Health and life insurance;
  • Vouchers for birthdays, marriage, babies;
  • Options for work from home;
  • Monday breakfasts;
  • Annual bonus;
  • Opportunity to work with the best in the sector;
  • Chance to acquire valuable experience working on various interesting projects for clients in Automotive, Healthcare, Pharma, e-commerce, FMCG, Construction, Lighting, Telco, Tourism industries.
Upload your CV/resume or any other relevant file. Max. file size: 16 MB.
More about this position
Help your friends find their dream job and share this ad on:
Share on FacebookShare on Google+Tweet about this on TwitterShare on LinkedIn
Your Talent Magnet