Web Crawler Developer

10 hours ago


Singapore RAPSYS TECHNOLOGIES PTE. LTD. Full time

Key Responsibilities Design, develop, and maintain web crawlers/scrapers to extract structured data from various partner websites. Handle complex HTML structures , pagination, and anti-bot mechanisms to ensure reliable data capture. Implement data transformation, cleaning, and enrichment pipelines for extracted datasets. Integrate with Azure services such as Azure Functions , Azure Storage , Azure Logic Apps , or Azure Data Factory for automation and orchestration. Utilize Vector Databases (e.g., Azure Cognitive Search , Pinecone , FAISS , or Weaviate ) for semantic indexing and retrieval. Incorporate multilingual translation APIs (e.g., Azure Translator , Google Translate ) to produce multi-language datasets. Ensure consistency in JSON structuring , REST API integrations , and maintain proper version control using Git. Key Skills & Qualifications Proficiency in Python , with experience using BeautifulSoup , Requests , and Selenium . Strong understanding of web scraping best practices and data processing workflows . Hands-on experience with Azure-based automation and data orchestration tools . Familiarity with vector search technologies and semantic retrieval methods. Knowledge of translation and localization APIs for multilingual data generation. Solid understanding of Git-based version control and RESTful architecture .


  • Web Crawler Developer

    2 weeks ago


    Singapore Rapsys Technologies Pte. Ltd Full time $60,000 - $120,000 per year

    Key Skills Required:Strong proficiency in Python, with hands-on experience using BeautifulSoup, Requests, and Selenium for web scraping.Proven experience building data crawlers/scrapers to extract place-of-interest and product information from multiple partner websites.Familiarity with data transformation and cleaning pipelines, including handling of HTML...


  • Singapore Rapsys Technologies Full time

    **Key Skills Required**: - Strong proficiency in **Python**, with hands-on experience using **BeautifulSoup**, **Requests**, and **Selenium** for web scraping. - Proven experience building **data crawlers/scrapers** to extract _place-of-interest_ and _product_ information from multiple partner websites. - Familiarity with **data transformation and cleaning...


  • Singapore Hytech Full time

    We are seeking a Market Intelligence Analyst with expertise in web crawling, data extraction, and competitive intelligence to join our BI team. In this role, you will design and implement Python-based crawlers to collect, analyze, and derive actionable insights from search engines, social media platforms, app stores, and industry news. Your work will...


  • Singapore HYPERGAI PTE. LTD. Full time

    **About HyperGAI** - HyperGAI, building Hyper General AI platforms with world's leading Multimodal Generative AI, empowers everyone to work and live better in a whole new way. We are a small but fast-growing Generative AI deep-tech startup, founded by globally renowned AI thought leaders and a group of exceptional AI experts, talented researchers and...

  • Crawler Crane Operator

    22 hours ago


    Singapore LT SAMBO CO., LTD. (SINGAPORE BRANCH) Full time $50,000 - $120,000 per year

    Job Requirements:Possess a valid crawler crane operator license.Without Crane License & working experience are welcome to applyWilling to do mechanical workWorking location : Jurong West Job Highlights:Career growth and development opportunitiesTraining providedexperience min 5 years


  • Singapore LT SAMBO GLOBAL PTE. LTD. Full time

    **Responsibilities**: - Career growth and development opportunities - Training provided No experience welcomed to apply **Job Requirements**: - Possess a valid crawler crane operator license, issued less than a year ago - Without Crane License & working experience are welcome to apply - Willing to do mechanical work - Singaporeans only - Working location...

  • Software Developer

    1 week ago


    Singapore TAU EXPRESS PTE. LTD. Full time

    **Position Summary** **Key Responsibilities**: - Application Development and Implementation - Participate in the requirement gathering and producing the required technical and operations documentation - Working with the tech team to develop and test the system according to the finalised software requirements - Produce quality development works & adhere to...

  • Web Developer

    2 weeks ago


    Singapore Total Shape Full time

    Job Summary: We're offering a competitive salary of $4,500 to $5,500 monthly for our next Web Developer!We're looking for someone with the talent and experience to help us create and maintain a top‐notch website for our customers. You'll be in charge of developing both the front and the back end of the website, ensuring everything runs smoothly and the...

  • Web Developer

    2 weeks ago


    Singapore GRAVITY GAME HUB (GGH) PTE. LTD. Full time

    **Web Developer** - Collaborate with the internal teams to design, build, enhance, and test new features on web/mobile - Identify and fix compatibility issues involving CSS, HTML, and scripting. - Research and explore various architectural considerations relating to the system design process, including web usability, the website’s performance, and database...

  • Web Developer

    1 week ago


    Singapore Emprego SG Full time

    Highlights Immediate Vacancy 5 days work week Salary up to SGD 4500 **Working Location**: Media Circle ( Free Shuttle Bus from designated MRT pick up point) Work collaboratively with design and development team Web template and web modules creation Experience in developing CMS Brainstorming creative ideas with various teams Ability to keep learning...