I'm a Big Data Engineer with 10+ years of experience in distributed systems, big data infrastructure, backend development, and enterprise data platforms.
My engineering experience spans the entire lifecycle of data platforms, from architecture integration, development, deployment, and cluster operations to troubleshooting, performance optimization, and version upgrades.
I enjoy understanding complex systems, investigating problems at the source-code level, and building reliable engineering solutions for real-world production environments.
- 10+ years of experience in Big Data Engineering and distributed systems.
- Experienced in building and maintaining large-scale Hadoop and HBase platforms.
- Hands-on experience with PB-scale HBase clusters and large-scale graph databases.
- Experienced in NebulaGraph development, troubleshooting, data migration, and cluster optimization.
- Familiar with distributed scheduling systems and big data component integration.
- NebulaGraph Community Contributor.
- Interested in AI-powered data platforms, intelligent operations, and knowledge engineering.
- Apache Hadoop / HDFS / YARN
- Apache HBase
- Apache Hive
- Apache Kafka
- Apache Flink
- Apache Spark
- Apache Flume
- Trino
- Elasticsearch
- NebulaGraph
- nGQL
- Graph Data Modeling
- Distributed Data Loading
- Data Migration & Cluster Optimization
- Java
- Spring Boot
- Python
- C++
- Shell Scripting
- SQL
- RESTful APIs
- MySQL
- Redis
- PostgreSQL
- MariaDB
- ZooKeeper
- Docker
- Kubernetes
- Linux
- Jenkins
- Ambari
- CDH
- Kerberos
- Ranger
- CI/CD
- Prometheus
- Apache SkyWalking
- JMX Exporter
- Nightingale
- Built and maintained enterprise-level big data infrastructure.
- Integrated and maintained multiple distributed data components.
- Developed platform components, patches, and version upgrade packages.
- Worked on automated deployment, configuration management, and cluster maintenance.
- Supported both offline and real-time data processing workloads.
- Maintained two PB-scale HBase clusters with 360 and 270 RegionServers respectively.
- Troubleshot Region In Transition (RIT), memory pressure, BulkLoad failures, and high-load scan operations.
- Participated in HBase version upgrades from 1.2.6 to 2.1.1.
- Worked on source-code analysis, bug fixing, data migration, and release packaging.
- Maintained three NebulaGraph clusters with approximately 30 billion graph records:
- 12 billion vertices.
- 18 billion edges.
- Investigated storage service failures and memory-related issues.
- Developed data ingestion pipelines using Java, Kafka, Spark, and DolphinScheduler.
- Participated in cluster separation, data migration, and performance optimization.
- Contributed to the NebulaGraph open-source community.
- Maintained an 8-node cluster with 3 Masters and 5 Workers.
- Developed API features and fixed workflow and task-instance issues.
- Improved scheduling reliability, resource utilization, and platform integration.
- Working with DataMind and DataOps platform integration and deployment.
- Involved in knowledge processing, corpus construction, and AgentBI-related modules.
- Used AI-assisted development to fix platform issues and improve development efficiency.
- Customized the open-source LabelU annotation platform and submitted contributions to its community.
- Explored data lakehouse technologies and intelligent data platform architectures.
- AI Agents and LLM-powered applications.
- Retrieval-Augmented Generation (RAG).
- Knowledge Graphs and Ontology Engineering.
- Semantic Modeling and Enterprise Knowledge Systems.
- Intelligent DataOps and AIOps.
- AI-assisted software development and automated troubleshooting.
- Integration of AI with Big Data infrastructure.
I believe that engineering is more than implementing features.
It is about understanding how systems work, identifying problems at their roots, improving architecture, and making complex technologies reliable and practical.
I enjoy reading source code, exploring open-source projects, sharing engineering knowledge, and continuously learning new technologies.
Understand the system. Solve the real problem. Build something meaningful.
I'm interested in open-source collaboration and technical discussions around:
- Big Data & Distributed Systems
- Graph Databases & Knowledge Engineering
- Cloud Native & DevOps
- AI Agents & Intelligent Data Platforms
Keep Exploring Β· Keep Building Β· Keep Improving π