Monday, 14 September 2020

Top 7 most used databases by developers in 2020

 Databases are designed to store and access information. A good database is critical for any company or an organisation. Stack Overflow Developer Survey has listed the top 7 databases used by developers around the world.


1. MySQL
This is clearly one of the most popular and oldest open source SQL database management systems. The Oracle developed database is a client/server-side system that consists of a multi-threaded SQL server.

2. PostgreSQL
PostgreSQL is an open-source object-relational database system. Some of the key features of PostgreSQL include reliability, robustness, and performance. It also uses and extends the SQL language combined with many features that store and scale the complicated data workloads. PostgreSQL offers a number of features aimed at helping developers build applications.

3. SQLite
This is an in-process library that implements a self-contained, serverless, zero-configuration and transactional SQL database engine. SQLite does not have any separate server process.

4. MongoDB
The general-purpose, document-based distributed database is built for modern application developers. MongoDB is one of the popular databases that include both scalability and flexibility. It can store data in a JSON-like document.

5. Redis
The open-source, in-memory data structure can be used as a database, cache, and message broker. Redis supports multiple data structures including strings, hashes, lists, sets and sorted sets with a range of queries, bitmaps, geospatial indexes. This database is written in ANSI C and works in most POSIX systems.

6. MariaDB
MariaDB server is one of the most popular database servers. It is developed as open-source software and relational database. MariaDB provides an SQL interface for accessing data.

7. Firebase
Google's Firebase an application development platform for building mobile and web applications. It provides adequate tools to help developers build high-quality apps and grow the user base. Firebase has various functions such as analytics, databases, messaging, and crash reporting.

Top 5 Python-based ETL tools to learn in 2020

 URL

https://content.techgig.com/top-5-python-based-etl-tools-to-learn-in-2020/articleshow/74489069.cms

ETL (Extract Transform Load) is a core component of data warehousing, which involves fetching data from one or many systems and loading it into a target data warehouse. ETL tools can define your data warehouse workflows. There are plenty of ETL tools available in the market.

Python continues to dominate the ETL space. There are over a hundred tools that act as a framework, libraries, or software for ETL. These tools become your go-to source once you start dealing with complex schemas and massive amounts of data. If you are good with Python, you will personally feel comfortable building your own ETL tool. Here are the top 5 Python-based ETL tools.

1. Apache Airflow

This Python-based workflow automation tool can be used to author workflows as Directed Acyclic Graphs (DAGs) of tasks. It uses all Python features to create your own workflows. Airflow's open-source nature makes it easier to set up and maintain data pipelines. Typical Airflow setup is as follows: Metadata database > Scheduler > Executor > Workers. It is a great addition to your existing ETL toolbox.

2. Luigi

Luigi is an open-source Python-based tool that lets you build complex pipelines. The tool was developed by Spotify to automate their insane workloads. It is currently used by a wide range of companies including Stripe and Red Hat. This tool helps you with Tasks and Targets. If you need to automate simple ETL processes, Luigi can handle them efficiently without much setup.

3. Pandas

Pandas is a library that provides data structures and analysis tools for Python. It adds R-Style data frames, making ETL processes much easier. You can do almost everything with Pandas if you are willing to invest enough time.

4. Bonobo

This Python-based ETL framework is lightweight and extremely easy to use. Bonobo allows extracting from various sources including CSV, JSON, XML, XLS, SQL etc. The entire transformation follows automatic UNIX principles. New users don't have to learn any new API to use Bonobo.

5. Bubbles

This is another Python framework that you can use to run ETL. Unlike some other ETL frameworks, Bubbles uses metadata to describe pipelines. While it is written for Python, it is technologically agnostic in nature.

Saturday, 7 March 2020

Google's Dart and Flutter

Dart is an object-oriented programming language by Google, which aims to help the developer build modern web applications. It covers client, server and now mobile with Flutter

Flutter uses Dart programming language which was introduced by Google in 2011 and is rarely used by developers. Dart syntax is easy to understand for JavaScript or Java developers as it supports most of the object-oriented concepts

Dart makes it easier to create smooth animations and transitions that run at 60fps. ... And like JavaScript, Dart avoids preemptive scheduling and shared memory (and thus locks). Because Flutter apps are compiled to native code, they do not require a slow bridge between realms (e.g., JavaScript to native).

Monday, 19 November 2018

Cloud, Big Data and Block-Chain

Cloud and Big Data - are two emerging technology currently.

Also, the Artificial Intelligence, Robotics, Internet of Things and the most upcoming Block-Chain Technology.

Block-Chain Technology - is not only meant for doing Encryption but also much more things than Encryption.

Friday, 2 September 2016

Agile SCRUM -> Roles, Ceremonies and Artifacts

Scrum has Three ROLES:

1. The Team
2. The Scrum Master
3. The Product owner

Scrum has Four CEREMONIES

1. The Sprint Planning Meeting
2. The Daily Scrum or  Daily Stand-up 
3. Backlog Grooming & Story Point Estimation
4. The Sprint Review Meeting
5. The Sprint Retrospective Meeting

Scrum has Three ARTIFACTS

1. The Product Increment
2. The Product Backlog
3. The Sprint Backlog

Monday, 29 August 2016

School Bag Weight Reduced...!!! Great Students....



When 12-year-old kids protested and got weight of their school bags reduced


Their schools now have lockers installed. All thanks to the press meet organized by two 12-year-old boys of Vidya Niketan School situated in the Chandrapur district of eastern Maharashtra. In the press conference, they openly voiced about the daily hardships they face due to the burdensome bags.
Representational Image; Source – BBC

“We carry a minimum of 16 books for 8 subjects daily and sometimes their number increases to 18 or 20, depending upon the subjects for which the classes would be held for the day. Our school bags weigh between 5 and 7 kg and its exhausting to carry them to our classroom located on the third floor,” the boys told PTI.
When asked if they were worried about facing disciplinary action from their schools, the boys said their demands were “just” and that they did not anticipate any problem.
The Maharashtra government had earlier issued a circular on guidelines on reduction of weight of schoolbags carried by students. Following the Bombay High Court’s directives, the State had informed principals and school managements across the state to follow the circular.
Only two days after the press conference, lockers were installed in the school premises for students to keep books and stationaries. But the fight is far from over. The students now plan to take this initiative to the national level and benefit all children slogging under heavy school bags.