Web Crawler C/C++ Tech Lead

Company Name:
Lucas Group
Our client just moved to Atlanta and is seeking development talent for their next generation systems.
Specializing in market intelligence served on demand, our client provides a variety of Web-based
that help clients make informed business decisions regarding products and pricing, competitive positioning, and consumer preferences.
The Role:

We are looking for a hands-on Senior Software Engineer with a strong academic track record and experience working on web crawling.
As a Senior Software Engineer you will work as part of our engineering team on building our next generation crawler from their existing scraping technology. The platforms today have capabilities to harvest product data from the web and generate reports for customers to be able to monitor their competitors prices and products. This is a great opportunity to join a group of engineers working with cutting edge technology in a hot space.

Your responsibilities will include:

Developing the next generation web crawler
Maintaining and or enhancing the existing crawler written in C/C++.
Scaling systems to handle higher loads
Leading innovation by exploring, investigating, recommending, benchmarking and implementing data-centric technologies for the platform
Being the technical architect and point person for the data platform
Collaborating with application engineering teams and providing platform support for applications in a very agile environment.
Working with product management feature requests to document engineering requirements.
Driving engineering requirements into an Engineering team located in India.
Occasional travel to the India team as well as to customers.

Data Experience Required:

- Knowledge in distributed databases, processing, filesystems.
- Hands on programming and development experience; excellent problem solving skills; proven technical leadership and communication skills
- Have a solid track record building large scale, fault-tolerant systems over the whole lifecycle of the project
- Strong understanding of how the various technical pieces fit together: you can explain why you made architectural/design decisions and chose certain tools/products.

Technical Skills Required:
5+ years of programming experience (Java, JBoss, C, C++, Oracle, Postgress)
Multithreaded distributed computing systems experience.
Knowledge of AWS cloud computing infrastructure.
Subversion (or similar) Familiarity.

Additional Skills recommended, but not required:
Experience with the Hadoop stack - MapReduce.
Experience with large scale distributed RDBMS (Teradata, Netezza, Greenplum, Aster Data, Vertica) is a plus.
Experience with key-value store technologies such as HBase and/or Cassandra

No Sponsorship
local candidates preferred

email resume to

Don't Be Fooled

The fraudster will send a check to the victim who has accepted a job. The check can be for multiple reasons such as signing bonus, supplies, etc. The victim will be instructed to deposit the check and use the money for any of these reasons and then instructed to send the remaining funds to the fraudster. The check will bounce and the victim is left responsible.

More Jobs

BI Tech lead
Atlanta, GA Tech Mahindra
Business Development Manager - C-Store Shopper...
Atlanta, GA VideoMining
C/UNIX Programmer Analyst
Tucker, GA Gainwell Technologies
Senior Logistics Support Analyst- C-5 - 35205
Warner Robins, GA Alion Science and Technology Corporation
C# Software Developer
Alpharetta, GA Ledgent Technology
Machine Operator W C
Senoia, GA ResourceMFG