Big Data Engineer in Columbia, SC

Big Data Engineer Job Description

Big data engineers are liaisons between business users and data scientists. They are designers and curators of databases and know how to get results from vast amounts of data quickly. They have impeccable data mining, strategic and communication skills, as they interpret business objectives and translate them into data-processing workflows. They develop, maintain, test, and evaluate software platforms and large-scale data processing systems within organizations, ensuring that data pipelines are scalable, efficient and secure. A big data engineer must have considerable expertise in statistics software engineering, building high-performance algorithms and programming, ideally in Python or Java and NoSQL technologies. The role requires coding expertise and enterprise architecture and data science knowledge. Employers often require a bachelor’s degree in a related field and four to six years of experience.

Typical big data engineer duties:

Gathering, storing and processing raw data and translating analyses for acquisition and integration

Applying technologies to solve big data problems and develop innovative big data solutions

Performing end-user analysis to formulate a clear understanding of the business needs and incorporate these needs into technical solutions

Looking for a big data engineer or a big data engineer job in Columbia?

Search for Big Data Engineer jobs in Columbia, SC or request talent now and our expert recruiters will be with you shortly.

Robert Half can assist you with your big data engineer recruitment needs in Columbia.

Apache Spark

HDFS

Apache Kafka

Sqoop

Python

Hadoop Hive

Apache Hadoop

AWS Technologies

Big Data

Cluster Analysis

Salary for Big Data Engineer in Columbia, SC

114680 - 163795

25th percentile

114680

New to the role, with little or no experience; requires more than casual instruction or supervision to perform day-to-day duties

50th percentile

140530

Has the experience to consistently perform core responsibilities without direct supervision; very comfortable with processes and subject matter associated with the role

75th percentile

163795

Value to the organization goes far beyond the ability to perform normal job duties; has rare qualifications that enable consistent contribution in unique ways; ready for next career level when available

Projected salaries for related positions

Position title

25th percentile

50th percentile

75th percentile

AI Architect

124080

153925

172020

Data Architect

126430

154160

175310

Data Scientist

111860

135595

156980

Database Manager

114915

138650

159800

Database Developer

101050

122670

138885

Database Administrator

83190

109275

125255

Business Intelligence Analyst – Technology

95175

116325

137710

Data Analyst – Technology

87420

106455

125960

Data Warehouse Analyst

83895

102930

126195

Report Writer

66035

80840

96820

Hiring? Start here.

Access millions of skilled contract and permanent candidates at every level from support roles to C-suite, and pinpoint the talent you need using our industry-leading matching technology.