Sr./Staff Software Engineer, Big Data
About Us:
ShareThis, a Predactiv Company is a big data company that owns online behavior data of 1b+ users globally. We are developing an audience intelligence platform with cutting edge big data technologies. We are looking for an innovative software engineer to join our exciting projects and platform development.
You will be responsible for big data software and platform architecture and development.
Requirements:
- 5+ years of experience in big data software and platform development
- Fluent in two or more of the programming languages such as Python, Scala, Java, GoLang
- Knowledge of microservices & serverless architectures
- Experience building large CI/CD pipelines
- Hands-on experiences in Spark and AWS EMR
- Strong experiences with AWS (S3, SQS, EMR etc)
- Strong automation skills with Python and/or Bash
- Experience working in fast-paced Agile teams
- Ability to learn new tools and workflows with little or no supervision
- Education· BS/MS in Computer Science or Software Engineering
Nice to Haves:
- Experience with GCS
- Experience with SQL/NoSQL Database
- Experience with Databricks is a plus
- Working knowledge of Security and Privacy in big data platform
- Experience with Azure, Snowflake is a plus
- Experience with Airflow