Historical Development of Big Data

Prior to 1980, corporations stored and analysed data on mainframe computers. Two important technologies had a critical role in the early creation of data centres as we know them today. The first was the advent of personal computers (PCs), which grew in popularity as Microsoft's Windows operating system became the global standard. Sun Microsystems' invention of the network system protocol, which allowed PC users to access network files, was the second. Following that, microcomputers began to occupy mainframe rooms as servers, and the spaces were nicknamed data centres.

Several key events have affected the industry's evolution since then, most notably the advent of virtualization software and the shift to cloud computing. The timeline below demonstrates these and other major turning points in the history of big data.

 

In 1943, the United Kingdom developed the first data-processing computer capable of breaking Nazi codes.

In 1945, ENIAC, the first electrical general-purpose computer, was completed.

1954 - The first entirely transistorised computer, with no vacuum tubes and only transistors and diodes, was built.

In 1964, IBM debuted the System/360 line of mainframe computer systems.

In 1971, Intel's 4004 became the first general-purpose programmable processor.

In 1973, Xerox released the first desktop computer with a graphical user interface and internal memory storage.

ARCnet created the first local area network (LAN) at Chase Manhattan Bank in 1977, connecting 255 computers.

The personal computer era began in 1981.

In 1983, IBM released DB2, the company's first commercially available relational database.

The Python programming language was first implemented in 1989.

In 1998, Carlo Strozzi built NoSQL, an open-source relational database.

VMware Workstation was released in 1999, allowing consumers to construct virtual machines.

Amazon Web Services (AWS) was founded in 2002 as a free service.

In 2006, AWS began providing web-based computer infrastructure services, sometimes known as cloud computing.

In 2007, Apple introduced the first iPhone, ushering in the mobile internet as we know it today.

The first 100 Gigabit Ethernet systems were introduced in 2010.

In 2011, Facebook launched the Open Compute Project to provide specs for energy-efficient data centres.

Docker released open-source OS container software in 2013.

Google and Microsoft lead significant data centre construction projects in 2015.

In 2017, Huawei and Tencent joined Alibaba in large data centre construction projects in China.

Leading data centre operators began the transition to 400G traffic speeds in 2018.

In 2018, silicon photonics technology began to have a favourable influence on data centre networking topologies.

Edge computing reshapes the cloud's position in important areas of the economy in 2020.

Data centre speeds are estimated to approach 1,000G in 2021.

Data centres will increasingly be on-device by 2025.

 

History of big data: Timeline (verdict.co.uk)

A Short History of Big Data | Big Data Framework