Role Overview
A(caps)s a Software Developer at Krawlnet Technologies, you will ensure uninterrupted data collection from multiple web sources, handle large datasets, maintain data pipelines, and resolve crawler-related issues. You will also be involved in developing tools to scrape complex websites and manage data flow with reliability and efficiency.
Company : Krawlnet Technologies
Position : Software Developer
Experience : 0 - 2 years
Qualification : Degree
Location : pune
Key Responsibilities
- Develop and maintain advanced web crawlers and data extraction tools.
- Manage large-scale structured and unstructured datasets.
- Troubleshoot crawler issues and ensure consistent data retrieval.
- Implement anti-blocking and anti-captcha strategies.
- Analyze and refine data to ensure quality and consistency.
- Follow established coding standards and contribute to system optimization.
Required Skills
- Strong command of Python (mandatory).
- Hands-on experience with tools like Scrapy, Selenium, Beautiful Soup, and regular expressions.
- Knowledge of headless browsers (e.g., Puppeteer) and web scraping frameworks.
- Familiarity with GitHub, SVN, and AWS environments.
- Understanding of JavaScript, HTML5, and CSS3 fundamentals.
- Good grounding in computer science concepts such as data structures, algorithms, and multi-threading.
- Excellent problem-solving and communication skills.
Preferred Skills
- Exposure to machine learning model deployment.
- Experience with DevOps tools (Docker, Kubernetes).
- Understanding of big data technologies like Hadoop, Spark, Kafka, or Airflow.
Application Process:
Interested candidates can send their updated resume to hr@krawlnet.com.
(getButton) #text=(Apply for this Job)
