Job Description
-
Global IT service company is looking for talented and creative DevOps engineers to join their team. The Data Engineering Group offers a relaxed but fast environment where creative and collaborative talent are rewarded. The team is very active and passionate about catching up and introducing cutting・edge technology from OSS (Open Source Software).
You will play a core role in administrating, monitoring and problem resolution on the current data engineering platform, and the cutting・edge data engineering technology R&D.
【Responsibilities】
‐ Design and development of the New Data Collection System, which will be the standard system
‐ Development & maintenance of the Data Pipeline System, that transfer and wrangle terabytes of data from various services using ELK, Apache Kafka, and Apache NiFi
‐ R&D for new Data Engineering Technology
‐ Collaboration with Dev/Ops Team and Implement Automated Operation System
Job Requirement
-
‐ Hands・on experience with Linux
‐ Experience, excellent programming skills in Java, Scala, or Python
‐ Experience in designing and building large・scale data application and pipeline in production
‐ Experience with DevOps tools and technology, such as Gradle, Maven, Jenkins, Git, IntelliJ, or Eclipse
‐ Must be self・organized and gritty on continuous improvements of the platform
‐ Must be a self・starter and good collaborator with good communication skills
【Skills Preferred】
‐ Hands・on experience with one of the following: ELK, Apache Kafka, and Apache NiFi
‐ Hands・on experience or great knowledge with Docker and/or Kubernetes
‐ Hands・on experience with Streaming framework, such as SparkStreaming and/or Flink
‐ Hands・on experience with Hadoop (HDFS, Hive/HiveLLAP, MapReduce, Spark on Yarn)
‐ Hands・on experience with BI Platform
‐ Hands・on experience with KVS, such as Couchbase, Cassandra, Redis
Language Ability
- English : Business Conversation Level (TOEIC 735-860)
- Japanese : None
Job Summary
Recruiter
Skillhouse Staffing Solutions K.K.
Employment Company
Company is not publicly visible
Job Type
IT (PC, Web, Unix) - Web Application SE
IT (PC, Web, Unix) - Business Application SE
IT (PC, Web, Unix) - Project Manager
Industry
Publishing/Advertising/Printing/Broadcasting
Salary
JPY 6,000,000 - 9,000,000
Other Salary Description
‐ Social insurance
‐ Transportation Fee
‐?No smoking indoors allowed (Designated smoking area)
Location
Asia Japan Tokyo
Asia Japan
Working Hours
9:00 - 17:30（Mon - Fri）
Holidays
Saturday, Sunday, and National Holidays
Job Contract Period
Permanent
- Your Recent Searches
- You Might be Interested In
