Skills

Python MySQL PostgreSQL Selenium Problem-solving Attention to detail Django

Job Specifications

Join a project focused on building a robust food ingredient database for a new app inspired by food scanners. The role centers on developing a backend solution to legally and efficiently scrape food item and ingredient data from major grocery retail websites. The collected data will be structured and stored in a MySQL or PostgreSQL database, supporting the app’s mission to provide users with detailed ingredient insights. The ideal candidate will have strong experience in Python and Django, with a proven track record in web scraping and data management. This is a single-project opportunity, perfect for a developer who thrives on building practical, scalable solutions for real-world applications.

Responsibilities

Design and implement a backend program to scrape food item and ingredient data from leading grocery retail websites
Ensure all scraping activities comply with legal and ethical standards
Develop a system to accept URLs and automate the extraction and storage of food data on each run
Structure and store the scraped data in a MySQL or PostgreSQL database for easy retrieval and analysis
Optimize scraping scripts for reliability, efficiency, and scalability
Collaborate on defining data categories and database schema to support app requirements
Document the scraping process, codebase, and database structure for future maintenance

Skills And Requirements

Proficient in Python and Django, with hands-on experience in backend development
Demonstrated expertise in web scraping using libraries such as BeautifulSoup, Scrapy, or Selenium
Strong understanding of data storage and management with MySQL or PostgreSQL
Knowledge of legal and ethical considerations in web scraping
Ability to design and implement scalable, maintainable code
Familiarity with RESTful APIs and data integration best practices
Excellent problem-solving skills and attention to detail
Self-motivated and able to deliver high-quality results independently
Availability for a single-project engagement, with flexibility to adapt to evolving requirements

About Twine

Twine is a leading freelance marketplace connecting top freelancers, consultants, and contractors with companies needing creative and tech expertise. Trusted by Fortune 500 companies and innovative startups alike, Twine enables companies to scale their teams globally.

Our Mission

Twine's mission is to empower creators and businesses to thrive in an AI-driven, freelance-first world.

About the Company

Twine is home to a network of over 750k+ freelance experts and 50k+ clients across 195 countries. We connect talented people with flexible work and help businesses find the perfect expert for any project - big or small. For Businesses & Clients: Tired of endlessly searching for the right talent? We've got you covered. Twine makes it easy to find and hire freelance experts in tech, creative, AI and more. From software developers and graphic designers to animators and content creators. Our global network means you can hire the... Know more