ETL / Data Engineer
Wireless DNA (WDNA)
Jun 2020 – present
- Design and build a big data architecture with Hadoop (HDFS) as storage and Spark as the query engine.
- Build an IoT alarm system with anomaly detection for 18K+ devices (MQTT, Pub/Sub).
- Develop an LSTM model to forecast mobile network saturation.
- Build ETL pipelines with Python, SQL, PySpark, Airflow and RabbitMQ.
- Develop REST APIs with FastAPI: internal services, alarms and public APIs.
- Ensure data quality: validate, clean and correct IoT and meteorological data.
- Design PostgreSQL databases and tune them for performance.
- Deploy with Docker and CI/CD on own servers; help develop them (GitFlow).



