Software Engineer – Bigdata

Job Location – USA

Job Type – Onsite

Full Time Role

Experience – 10+ Yrs

Education – Bachelor’s degree or equivalent in Computer Science, Computer Information Systems, Information Technology, or a related degree

Salary – Open for Discussion

Job Descriptions: –

• Develop, create, and modify computer applications. Analyze user needs and software requirements to determine feasibility of design. Provide support and administration of computer applications and software programs.
• Implementation of business approved transformation/logics using Vector pipeline, Python connector creation for aforesaid transformations.
• Analyzed the source data and designed the solution to implement using Python/Vector flow.
• Experienced in handling large datasets using Partitions, Memory utilizations, replication, load balancing, Fault tolerance, Transformations and other during ingestion process itself.
• Visualization of transformed data sets from Splunk tool.
• Handling and managing structured and semi-structured data and writing python connectors.
• Development and deployment of code and subsequently deploy in PRODUCTION server for down-streams.
• Develop Elastic search index and exposing as rest-full web-services for client consumption.
• Evaluate new technologies, execute proof-of-concepts and develop specialized algorithms.
• Participate in planning, definition, high-level design and code review of the solution and explore solution alternatives with team members.
• Create end to end technical design for the define business requirements, data governance rules and data domain transformation to Bigdata analytical data model.
• Define the structure of the system, its interfaces, and the principles that guide its organization, software design and implementation.
• Define architecture for Data Lake, Reporting mart, Extract data mart, Elastic Search data marts, In-house reporting and various Vendor extracts.
• Review and approve the test strategy and test plan.
• Assist for User Acceptance Testing and helping them setting up complex data to validate the scenarios.
• Preparing Technical Specification Documents, System Integration Testing Documents and User Acceptance Testing Documents.
• Attending daily hurdle meeting, weekly and monthly meetings with senior management.
• Work closely with team to ensure successful project completion.

If interested, please share your updated resume along with contact details to [email protected]