Introduction Avro is an open source project that provides data serialization and data exchange services for Apache Hadoop. These services can be used together or independently. Avro facilitates the exchange of big data between programs written in any language. With … Continue reading AVRO for Hadoop and Analytics
An open source storage layer that brings reliability to data lakes. Delta Lake provides ACID transactions, scalable metadata handling, and unifies streaming and batch data processing. Runs on top of your existing data lake and fully compatible with Apache … Continue reading Delta Lake
ADF A performant, robust, and cost-effective mechanism to migrate data at scale from Amazon S3 to Azure Blob Storage or Azure Data Lake Storage Gen2. Offers a serverless architecture that allows parallelism at different levels, which allows developers to build … Continue reading Azure Data Factory (ADF)
vPIC The NHTSA Product Information Catalog Vehicle Listing (vPIC) Application Programming Interface (API) provides different ways to gather information on Vehicles and their specifications. The vPIC Dataset is populated using the information submitted by the Motor Vehicle manufacturers through the 565 submittals. All the information on how a VIN is assigned by the manufacturer is captured in this catalog and used to decode a VIN and extract vehicle information Example code Continue reading vPIC
Covid-19 Article Continue reading Covid-19 Article
Brief update on data science in a world affected by Covid-19 Continue reading Models – Covid 19
