underwood's user avatar
underwood's user avatar
underwood's user avatar
underwood
Data Engineer at Retail
  • Member for 8 years, 10 months
  • Last seen more than a week ago
Profile Activity
Stats
863
reputation
111k
reached
1
answer
33
questions
Communities
View all
About

I'm a seasoned Data Engineer with over-lapping qualities of Data Scientist. I love designing and implementing data pipelines. I also enjoy helping our Dev Ops guys to set up the CI/CD process for these pipelines.

Badges
View all badges
2
gold badges
12
silver badges
22
bronze badges
Top tags
View all tags
0
Score
20
Posts
59
Posts %
0
Score
12
Posts
35
Posts %
0
Score
10
Posts
29
Posts %
0
Score
9
Posts
26
Posts %
0
Score
5
Posts
15
Posts %
0
Score
4
Posts
12
Posts %
Top posts
View all questions, answers, and articles
question
25
ETL in Java Spring Batch vs Apache Spark Benchmarking
Dec 9, 2018
question
19
How to find the most recent partition in HIVE table
Mar 18, 2016
question
9
KStreams + Spark Streaming + Machine Learning
Dec 13, 2016
question
4
HIVE escaped by not working '\\'
May 7, 2016
question
2
Pass columnNames dynamically to cassandraTable().select()
Aug 4, 2016
question
2
SPARK - Join Large Dataset with Smaller Dataset on Daily Basis
Dec 1, 2016
question
2
Kafa + Structured Streaming : Read from topics in parallel
Mar 1, 2021
question
2
Unittest (PyTest) function used in mapPartitions() in PySpark
Jul 15, 2022
question
1
Return Boolean (1 or 0) if table contains duplicate rows
Sep 9, 2015
question
1
HIVE : Replace string/ pattern in row if it exists else do nothing
Feb 18, 2016