Bigdata Project on Business insights of User usage records of data
Some information on a BigData Hadoop Project – Business insights of User usage records of data cards
Software requirement and operating system required for Business insights of User usage records of data cards
The operating system used is Linux. The technology used is Hadoop version 1.1.2 , and Hive, Sqoop tools are used with Hadoop. The tool used for reporting is Tableau. mySQL is used for the database for storing data, and the JDK 1.16 or higher version of Java is used for scripting.
Hardware used
Each cluster consists of five nodes or machines. Each node has an Intel processor with processor speed 2.5 Ghz or above, Eight GB or more memory and a hard disk capacity of 500 GB or more for storing data.
Project description
The aim of the project is to get insights into the records of the data of current users for business purposes. These insights are then used to take suitable actions to help the business grow
Parameters which are considered
- For every time slot the user count, data uploaded and downloaded
- The contribution of each area to the overall business
- In areas where the business does not have a service tower, it has to depend on partners for getting network data
How Hadoop can help in getting insights
Earlier the data was analyzed using technologies for warehousing data, which were taking up more resources. Now Hadoop and Hadoop echo technology can help in analyzing the data more quickly and efficiently, so that a decision can be take by the business to improve efficiency, optimize use of resources, leading to increased profit.
Data transfer and user information
Resources are required for every user who is connected to the system, for providing information which the user is requesting. Using Hadoop, it is possible to find out at what time of the day, a higher number of users are connected to the system, when more data is downloaded from and uploaded to the system. If the system is overloaded, it could make it slow. So this information, is used to enhance the system if it is overloaded, by adding hardware and increasing bandwidth. On the other hand, if part of the system is underutilized, it could be moved elsewhere.
Business data for each area
The area wise information on the sales, can help in taking the right decision for investing resources to increase sales
Tower installation
In areas where the business is using the network of a partner extensively, it is advisable to increase the owned tower installations, to reduce dependence on the partner.
Big Data Hadoop Project:
A big data project is a very complex project and it is a huge data management project. In this project, we are going to analyze the user usage data of data cards and then we are going to extract useful information from that data.
The data will be collected from the users who are using data card for the first time and then they will be sent to our system for further analysis.
We will use Hadoop technology to collect and store the data and then we will analyze it. The output will be a report which will show the usage statistics of data cards and the types of data cards that are used by the user.
Let’s see how will this data help us in the future:
User’s profile:
The output will be a detailed profile of the user. It will tell us his name, address, age and gender.
Usage history:
It will help us to know the type of data cards that are being used by the user and how often he is using that data card.
Useful data cards:
It will help us to know the data cards that are being used by the user and how frequently he is using that data card.
This will be helpful for the companies who are providing the data cards to the users.
We will get some interesting insights from this project.
What are the challenges of this project:
- It will take a lot of time to collect the data and then we will have to analyze it.
- We will have to hire a lot of people to collect the data.
- A huge amount of data will be stored and analyzed and then we will have to save it.
- There will be a lot of noise in the data and it will take time to find out the useful data.
- We will have to store the reports in our database and then it will be a big problem.
Conclusion:
This is an interesting project and it will provide us some useful information about the users and the data cards that are being used by the users. I hope you liked it.
English