At Compile, our team of data scientists and machine learning experts has built a unique engine that sifts through the deep public web to find opportunities, which other lead generation sources
Designation – Big Data Engineer
Location – Bangalore
About employer– Compile
Job description:
We are looking for an engineer who is passionate about transforming mountains of data into actionable information. Big Data is not just a buzz word for you
Responsibility
- You will be responsible for designing and building large scale crawling frameworks
- You will shape features and ideas into well structured architectural components
- Over time you will grow from being an individual contributor to leading a team of skilled engineers in solving large scale problems
Qualification and Skills Required
- You are graduate (BS/BTech/MS/MTech) in computer science or mathematics from a reputed institute.
- You have 3-4 years of experience, with atleast 2 years in this domain(absolutely required)
- Experience in solving complex issues in a distributed system
- Very comfortable with Nutch/Heritrix, Hadoop and HDFS, and one of Hive, Pig, or similar tools.
- Experience in NoSQL tools and technology (HBase, Cassandra, CouchDB, MongoDB)
- Deep knowledge of tuning search engines like Solr, Elastic Search, Lucene
- Experience in managing huge datasets and creating large scalable applications
- Good understanding of OOP and OOD and Full life cycle development
- Familiar with technologies like Accumulo, Storm is a plus
Interested people can apply for this job can mail their CV to [email protected] with subject as Big Data Engineer– compile– Bangalore
