Web Crawler C/C++ Tech Lead
Company Name:
Lucas Group
Our client just moved to Atlanta and is seeking development talent for their next generation systems.
Specializing in market intelligence served on demand, our client provides a variety of Web-based
services
that help clients make informed business decisions regarding products and pricing, competitive positioning, and consumer preferences.
The Role:
We are looking for a hands-on Senior Software Engineer with a strong academic track record and experience working on web crawling.
As a Senior Software Engineer you will work as part of our engineering team on building our next generation crawler from their existing scraping technology. The platforms today have capabilities to harvest product data from the web and generate reports for customers to be able to monitor their competitors prices and products. This is a great opportunity to join a group of engineers working with cutting edge technology in a hot space.
Your responsibilities will include:
Developing the next generation web crawler
Maintaining and or enhancing the existing crawler written in C/C++.
Scaling systems to handle higher loads
Leading innovation by exploring, investigating, recommending, benchmarking and implementing data-centric technologies for the platform
Being the technical architect and point person for the data platform
Collaborating with application engineering teams and providing platform support for applications in a very agile environment.
Working with product management feature requests to document engineering requirements.
Driving engineering requirements into an Engineering team located in India.
Occasional travel to the India team as well as to customers.
Data Experience Required:
- Knowledge in distributed databases, processing, filesystems.
- Hands on programming and development experience; excellent problem solving skills; proven technical leadership and communication skills
- Have a solid track record building large scale, fault-tolerant systems over the whole lifecycle of the project
- Strong understanding of how the various technical pieces fit together: you can explain why you made architectural/design decisions and chose certain tools/products.
Technical Skills Required:
5
years of programming experience (Java, JBoss, C, C++, Oracle, Postgress)
Multithreaded distributed computing systems experience.
Knowledge of AWS cloud computing infrastructure.
Subversion (or similar) Familiarity.
Additional Skills recommended, but not required:
Experience with the Hadoop stack - MapReduce.
Experience with large scale distributed RDBMS (Teradata, Netezza, Greenplum, Aster Data, Vertica) is a plus.
Experience with key-value store technologies such as HBase and/or Cassandra
No Sponsorship
local candidates preferred
email resume toEstimated Salary: $20 to $28 per hour based on qualifications.
Lucas Group
Our client just moved to Atlanta and is seeking development talent for their next generation systems.
Specializing in market intelligence served on demand, our client provides a variety of Web-based
services
that help clients make informed business decisions regarding products and pricing, competitive positioning, and consumer preferences.
The Role:
We are looking for a hands-on Senior Software Engineer with a strong academic track record and experience working on web crawling.
As a Senior Software Engineer you will work as part of our engineering team on building our next generation crawler from their existing scraping technology. The platforms today have capabilities to harvest product data from the web and generate reports for customers to be able to monitor their competitors prices and products. This is a great opportunity to join a group of engineers working with cutting edge technology in a hot space.
Your responsibilities will include:
Developing the next generation web crawler
Maintaining and or enhancing the existing crawler written in C/C++.
Scaling systems to handle higher loads
Leading innovation by exploring, investigating, recommending, benchmarking and implementing data-centric technologies for the platform
Being the technical architect and point person for the data platform
Collaborating with application engineering teams and providing platform support for applications in a very agile environment.
Working with product management feature requests to document engineering requirements.
Driving engineering requirements into an Engineering team located in India.
Occasional travel to the India team as well as to customers.
Data Experience Required:
- Knowledge in distributed databases, processing, filesystems.
- Hands on programming and development experience; excellent problem solving skills; proven technical leadership and communication skills
- Have a solid track record building large scale, fault-tolerant systems over the whole lifecycle of the project
- Strong understanding of how the various technical pieces fit together: you can explain why you made architectural/design decisions and chose certain tools/products.
Technical Skills Required:
5
years of programming experience (Java, JBoss, C, C++, Oracle, Postgress)
Multithreaded distributed computing systems experience.
Knowledge of AWS cloud computing infrastructure.
Subversion (or similar) Familiarity.
Additional Skills recommended, but not required:
Experience with the Hadoop stack - MapReduce.
Experience with large scale distributed RDBMS (Teradata, Netezza, Greenplum, Aster Data, Vertica) is a plus.
Experience with key-value store technologies such as HBase and/or Cassandra
No Sponsorship
local candidates preferred
email resume toEstimated Salary: $20 to $28 per hour based on qualifications.
|
|
 | |
