Title: Consultant/Sr. Engineer/Engineer.
Company Name: Smart Technologies (BD) Ltd.
Vacancy: 01
Job Location: Anywhere in Bangladesh
Employment Status: Full-time
Educational Requirements:
∎ Bachelor of Science (BSc) in Computer Science & Engineering
Experience Requirements:
∎ 6 to 8 year(s)
Job Responsibilities:
∎ Setup Hadoop cluster on Amazon EC2 using whirr for POC.
∎ Worked on analysing Hadoop cluster and different big data analytic tools including Pig Hbase database and Sqoop
∎ Responsible for building scalable distributed data solutions using Hadoop
∎ Installed and configured Flume Hive Pig Sqoop HBase on the Hadoop cluster.
∎ Managing and scheduling Jobs on a Hadoop cluster.
∎ Implemented nine nodes CDH3 Hadoop cluster on Red hat LINUX.
∎ Worked on installing cluster commissioning decommissioning of datanode namenode recovery capacity planning and slots configuration.
∎ Resource management of HADOOP Cluster including adding/removing cluster nodes for maintenance and capacity needs
∎ Involved in loading data from UNIX file system to HDFS.
∎ Created HBase tables to store variable data formats of PII data coming from different portfolios.
∎ Implemented best income logic using Pig scripts.
∎ Implemented test scripts to support test driven development and continuous integration.
∎ Responsible to manage data coming from different sources.
∎ Installed and configured Hive and also written Hive UDFs.
∎ Experienced on loading and transforming of large sets of structured semi structured and unstructured data.
∎ Cluster coordination services through Zookeeper.
∎ Experience in managing and reviewing Hadoop log files.
∎ Exported the analysed data to the relational databases using Sqoop for visualization and to generate reports for the BI team.
∎ Analysed large amounts of data sets to determine optimal way to aggregate and report on it.
∎ Supported in setting up QA environment and updating configurations for implementing scripts with Pig and Sqoop.
∎ Environment Hadoop HDFS Hive Flume HBase Sqoop PIG Java JDK 1.6 Eclipse MySQL and Ubuntu Zookeeper Amazon EC2 SOLR.
Additional Requirements:
∎ Big Data Ecosystem HDFS HBase Hadoop MapReduce Zookeeper Hive Pig Sqoop Flume Oozie Cassandra
∎ Languages:
∎ Mandatory: Java SQL/PLSQL.
∎ Good knowledge on C C PHP.
∎ Methodologies Agile V-model.
∎ Database:
∎ Good knowledge on Oracle 10g DB2 MySQL MongoDB CouchDB MS SQL server Amazon EC2
∎ Web Tools :
∎ Mandatory: HTML Java Script XML ODBC JDBC
∎ Good knowledge on Java Beans EJB MVC Ajax JSP Servlets Java Mail Struts Junit
∎ IDE / Testing Tools:
∎ Good knowledge on Eclipse.
∎ Operating System : Linux
∎ Good knowledge on Windows UNIX
∎ Scripts
∎ Mandatory: JavaScript Shell Scripting
Salary: Negotiable
Compensation & Other Benefits:
∎ Mobile bill, Provident fund
∎ Lunch Facilities: Partially Subsidize
∎ Salary Review: Yearly
∎ Festival Bonus: 2
Application Deadline: 28 Jul 2020
Company Information:
∎ 28 Jun 2020
∎ Smart Technologies (BD) Ltd.
∎ Address : Jahir Smart Tower, 205/1-205/1/A, West Kafrul, Begum Rokeya Sharani, Mirpur, Dhaka
∎ Web : www.smart-bd.com
∎ Business : IT Product Sales & Distribution, National Distributor of Huawei Mobile, Enterprise Solutions, Security & Surveillance, Software, Stationery Goods, Properties, Lenovo Mobile and Motorola Mobile etc
Category: IT/Telecommunication
Source: bdjobs.com