Is there a job opening for a Java Developer (Web Crawler) in Austin, TX, USA?

Axiom Software Solutions Limited is currently hiring a Java Developer (Web Crawler) in Austin, TX, USA.

Does Axiom Software Solutions Limited hire Java Developer (Web Crawler)?

Axiom Software Solutions Limited looking to hire a qualified Java Developer (Web Crawler) in Austin, TX, USA.

Top

Java Developer (Web Crawler)

Austin, TX, USA

401 Days ago

Save Job Job Expired

Job Description

Role: Java Developer with Web Crawler Experience

Location: Austin TX(Hybrid)

Responsibilities:

1.Web Crawler Development: Design and implement efficient and scalable web crawlers in Java to collect data from various online sources.

2.Data Extraction: Develop and maintain systems for structured data extraction, handling various data formats (HTML, JSON, XML, etc.).

3.Data Storage and Processing: Design data storage and processing pipelines, ensuring extracted data is clean, structured, and easily accessible.

4.Performance Optimization: Optimize web crawling processes for speed, efficiency, and accuracy, while ensuring minimal impact on source websites.

5.Error Handling and Logging: Implement error-handling mechanisms and logging systems to detect and resolve issues during crawling operations.

6.Data Integrity and Compliance: Ensure data collection practices are ethical, legal, and compliant with relevant regulations (e.g., robots.txt, copyright laws).

Requirements:

Proficiency in Java and experience with Java-based web scraping libraries (e.g., Jsoup, Apache HttpClient).

Knowledge of web crawling frameworks and tools, such as Scrapy, Selenium, or Puppeteer.

Strong understanding of HTML, CSS, JavaScript, and web data structures.

Familiarity with data parsing and handling techniques for JSON, XML, and other common formats.

Experience with database technologies (SQL, NoSQL) to store and manage scraped data.

Knowledge of HTTP protocols, headers, proxies, and load handling.

Key Skills Required

JavaSQLHTMLXMLCSSJavaScriptJAVAApacheData extractionJavaJSONComplianceData CollectionData IntegrityData StorageDatabaseDatabase TechnologiesDesignDevelopmentLoggingNoSQLOptimizationParsingSeleniumWeb Scraping

Job Overview

Job Function: IT/Computers - Software & Software Services

Job Type: Full Time

Workplace Type: Not Specified

Experience Level: Not Specified

Salary: Competitive & Based on Experience

Experience: 0 - 0 yrs

Contact Information

Company Name: Axiom Software Solutions Limited

Recruiting People: HR Department

Website: https://www.axiomsoftwaresolutions.com/

Location

Important Alert:
Beware of people who promise you a job or interview in exchange for money. If someone asks you for money and says it's for something like a registration fee or a refundable deposit, it could be a scam. Please be cautious. Remember, elsejob.com does not guarantee a job or interview in exchange for money, so don't give money to anyone like that.