Senior Engineer of Big Data Platform

1. Responsible for the company-level general data platform and analytical products, serving dozens of user product lines of Toutiao 2. Facing PB-level ultra-large-scale data problems, processing hundreds of billions of incremental user behavior data every day 3. Providing services for the entire life cycle of big data, covering the entire process of data generation, transmission, modeling, statistical analysis, experimental evaluation, and visualization 4. Build well-designed data streams, data warehouses, scheduling systems, query engines, data services, analysis systems, process specifications, data tools/products, lower the threshold for data use, ensure stable and efficient operation of the system, and realize the maximum value of data.

1. Familiar with a number of tools/frameworks related to big data processing/analysis, e.g. Hadoop, Mapreduce, Hive, Storm, Spark, kylinscribe, kafka, hbase, canalsqoop etc. 2. Strong coding ability, fast troubleshooting ability in production environment, and a strong enthusiasm for learning new technologies 3. Excellent understanding and communication skills, can quickly understand the business background, be sensitive to data, advocate data speaking, believe in the value of data in driving business and supporting decision-making, and those with web application development capabilities are preferred.