Asimo Kumar Mallick

1. Practical experience in big data storage, querying, processing, and analysis using modern Hadoop and real-time data technologies. 2. Hadoop tools such as HDFS, Hive, Sqoop, Apache Spark, and AWS. 3. Proficient in DataFrame operations for processing large structured and semi-structured datasets, including filtering, mapping, aggregation, and grouping. 4. Developed custom data transformation workflows using PySpark, leveraging AWS S3 as the primary storage layer. 5. Proficient in Hive, including the creation and management of managed, external, and partitioned tables. 6. Deep understanding of Hive file formats such as ORC, Parquet, and Avro, along with the ability to choose appropriate formats based on performance and storage needs. 7. Developed Spark-based ETL pipelines using RDDs in Scala, Java, and Python for distributed data processing. 8. Experienced in fine-tuning RDD performance via configuration optimization, including memory management, caching strategies.