
Python Developer
1 week ago
We are looking for a Python Data Engineer to within the Data Team of the client's IT Department. This position is part of a project-based engagement expected to run for 6-9 months, focused on building web scrapers and data ingestion pipelines for the client Tokyo Japan Power Trading Team.
The role has the following stakeholders and reporting lines:
- Team and Line Manager: This role will report to the Data Engineering Manager and will be managed by a Senior Data Engineer in the team.
**The role will cover below areas**:
- Collaborate with BAs to clarify requirements in a fast-paced environment.
- Develop scalable Python and PySpark scrapers integrated with existing Databricks frameworks.
- Ingest structured and unstructured data from websites (HTML, PDF, Excel, APIs, CSV, etc.).
- Build and test scrapers in Databricks (DBX), following GM design patterns and using shared libraries.
- Use ADF for orchestration and integrate with GM frameworks for logging, error handling, and translation.
- Write clean, reusable Python code for data processing, automation, and transformation.
- Monitor, debug, and maintain data pipelines to ensure reliability and fast issue resolution.
- Review technical specifications and work closely with FO Analysts for validation and clarification.
- Ensure scrapers support Japanese websites with power market data and adhere to HTML/API nuances.
- Follow IaC and AZD standards as per GM setup for deployment and infrastructure.
- Document pipelines and approaches based on existing standards; explain solutions clearly to users.
- Present work regularly to the Data Engineering Manager, wider team, and Head of Data when needed.
- Validate solutions against functional and non-functional requirements.
- Demonstrate a proactive, problem-solving, and delivery-focused mindset.
**Experience Required**:
- Extensive technical knowledge and experience (5-8 years) of:
**Technologies**:
- Strong expertise in Python programming and SQL.
- Hands-on experience with web scraping and industry best practices.
- Familiarity with Python libraries for language translation (nice to have).
- Knowledge of modern cloud-based data architectures, including Data Lakehouse on Databricks.
-
Python Developer
4 days ago
Singapore Rapsys Technologies Full time**Job description** Need AI python Developer A person with these skills will be handy Develop efficient, reusable Python code while adhering to OOP, DRY, and TDD practices. Collaborate with cross-functional teams to deliver features in an Agile environment. Troubleshoot, optimize, and ensure performance of cloud-based systems. Participate in code...
-
Python Developer
1 day ago
Singapore KS Talent Solutions Full timeKS Talent Solutions SingaporePosted 8 hours ago Permanent S$100k - S$150k - M- Posted by - Malvika Chordia- RecruiterFollow - My asset management client is looking for a Python developer to join them based in Singapore. My asset management client is looking for a Python developer to join them based in Singapore. **Key skills Required** Python - PySpark,...
-
Python Developer
1 day ago
Singapore RIDIK TECHNOLOGY SERVICES PTE. LTD. Full timeMust have Python data development skills Pyspark development skills (preferred) Data analysis and support skills Develop and automate ETL service using python and dask to cleanse, transform and load data into db. Develop visualization dashboards Manage Elastic search for data ingestion
-
Python Developer
7 days ago
Singapore PLOY ASIA PTE. LTD. Full timeWrite effective, scalable code - Develop back-end components to improve responsiveness and overall performance - Test and debug programs - Improve functionality of existing systems - Implement security and data protection solutions - Assess and prioritize feature requests - Coordinate with internal teams to understand user requirements and provide technical...
-
Python Developer
1 day ago
Singapore KS Talent Solutions Full timeMy asset management client is looking for a Python developer to join them based in Singapore. **Key skills Required** Python - PySpark, Spark SQL, Delta Live Tables & Parquet.
-
Python Developer
1 day ago
North-East Singapore Unison Consulting Pte Ltd Full timeWrite clean, efficient, and maintainable code. - Collaborate with cross-functional teams to design, develop, and deploy new features. - Troubleshoot and debug issues in existing codebase. - Participate in code reviews and provide constructive feedback. - Stay up-to-date with industry best practices and emerging technologies. **Requirements**: - Proven...
-
Python Developer
2 days ago
Singapore ELLIOTT MOSS CONSULTING PTE. LTD. Full time**Key Responsibilities**: - Collaborate with cross-functional teams to gather requirements and deliver high-quality solutions. - Build and optimize backend systems, RESTful APIs, and third-party integrations. - Implement data processing pipelines and perform basic to advanced data analysis. - Write clean, maintainable, and efficient code aligned with best...
-
Python Developer
1 week ago
Singapore NTT Data Singapore Full time**Python Development**: - Develop efficient, reusable Python code while adhering to Object-Oriented Programming (OOP), Don't Repeat Yourself (DRY), and Test-Driven Development (TDD) principles. **Cloud Infrastructure**: - Ensure the scalability, performance, and security of cloud-based systems. **Collaboration and Agile Development**: - Collaborate with...
-
Python Developer
4 days ago
Singapore R SYSTEMS (SINGAPORE) PTE LIMITED Full time**Responsibilities**: - Write effective, scalable code - Develop back-end components to improve responsiveness and overall performance - Test and debug programs - Improve functionality of existing systems **Requirements**: - Work experience as a Python Developer - Expertise in at least one popular Python framework (like Django, Flask, Pyramid) - Knowledge...
-
Python Developer
2 days ago
Singapore Infosys Consulting Full timeGet AI-powered advice on this job and more exclusive features. Direct message the job poster from Infosys Consulting We're seeking a skilled Python Developer with at least 5 years of hands-on experience in the full development lifecycle of mid to large-scale applications. The ideal candidate will be responsible for designing, developing, and maintaining...