SINGAPORE CLASSIFIEDS
Singapore Classified Advertisements & Listings from Singapore Expats
« Previous Ad · Next Ad »
Tools used in Big Data Analysis
1. Hadoop : data infrastructure framework that manages the storage and processing of big datasets. Analyze both structured and semi-structured data. Hadoop uses distributed storage and does parallel processing for handling large quantity of data. Hadoop must be interfaced with an external machine learning library like Apache Spark, to perform analytical tasks.
2. Apache Spark : is a distributed processing system used for handling big data workloads. Spark has its own machine learning library MLib. Capable of handling advanced analytical operations
Even though Spark is said to work faster than Hadoop, it does not have its own distributed storage system (where large datasets can be stored in infinite number of servers like Hadoop, which is scalable and cost-efficient). For this reason, Spark is installed above Hadoop, so that Sparks advanced analytical application can make use of Hadoop Distributed File System (HDFS).
3. Data Integration Software: Applications that allow big data to be streamlined across different platforms like mongodb, hadoop, Amazon EMR etc.,
4. Stream analytical tool : Systems that sort, aggregate and analyze data, that are stored in different platforms and formats such as Kafka which are used for building real time data pipelines and streaming applications..
5. Distributed Storage: Database that can split data across multiple servers with capability to identify lost or corrupt data such as Apache Cassandra which is a distributed NoSql Database Management System..
6. Data Warehouse
7. NoSql Database which does not require a fixed schema and hence it is also suitable for unstructured data also and various other data models
8. Data Mining Tools
9. Predictive Modeling Tools
10 Tableau: end-to-end data analytic platform that allows you to analyze, collaborate and share your big data insight in real time.
11. QlikView is a Business Intelligent and Data Visualization tool that enables users to analyze and share data using interactive dashboards, reports and charts.
12. Talend is a data integration platform that enables organizations to extract, transform and load (ETL) data from various sources into the target system.
13. Splunk : is an advanced scalable platform that searches, analyses and visualizes machine-generated data from websites, sensors, applications etc in order to provide metric, diagnose problems, and gain insights into business problems.
14. Plotly: is a python library that facilities interactive visualization of big data.
URL : www.edujournal.com
Please Login and use the Contact User form to contact the advertiser directly.
