Connect Helical Insight to Cassandra using Thrift Server

Approach

Helical Insight(BI) -> Fire SQL Query -> Map Cassandra with hive (one-time activity) -> Fetch data from Cassandra Just in Time

This approach involves creation of mapping tables in Hive meta-store of SPARK which have one-to-one mapping to Cassandra DB tables. Helical Insight can connect to this Hive meta-store using SPARK’s Thrift Server which allows JDBC connections to the same. SQL queries can be fired through this connection to fetch the data required for the reports.

Configure Spark to connect to Cassandra

Go to the spark default config file and add the cassendra connection details which are provided below.

Path: E:\Helical\SPARK\spark-2.0.2-bin-hadoop2.7\conf\spark-defaults.conf

Note: In your case sapark installation directory may change.

Add below lines: 

spark.cassandra.connection.host <cassandra host ip>


spark.cassandra.connection.port <cassandra port>


spark.cassandra.auth.username <cassandra login username>


spark.cassandra.auth.password <cassandra login password in plain text>

Configure Spark Thrift Server

1. Starting the Thrift Server with Datastax Spark Cassandra Connector in its class path

Sample command : 


<spark-home>:\bin>:spark-submit --verbose --class org.apache.spark.sql.hive.thriftserver.HiveThriftServer2 --hiveconf hive.server2.thrift.port=20000 --jars \spark-cassandra-connector-2.0.0-M2-s_2.11.jar  --driver-memory 512m

2. Create mapping tables in SPARK’s Hive Metastore

    a. Connect to Spark SQL Thrift Server using beeline / any other tool

    ./bin/beeline -u jdbc:hive2://:20000

    b.Hive Database creation by running below database creation commands.

    Here we are creating TravelData database and using it.

    1) Create database TravelData;

    2) Use TravelData;

    Note: Database name in your case is different

    c. Hive Tables Creation and mapping Cassandra tables to Hive Tables

    Here we are creating the 3 tables employee_details, meeting_details and traveldetails.

    employee_details table creation:

    create table employee_details using org.apache.spark.sql.cassandra options (cluster ‘Test Cluster’, keyspace ‘TravelData’, table ’employee_details’);

    meeting_details table creation:

    create table meeting_details using org.apache.spark.sql.cassandra options (cluster ‘Test Cluster’, keyspace ‘TravelData’, table ‘meeting_details’);

    traveldetails table creation:

    create table traveldetails using org.apache.spark.sql.cassandra options (cluster ‘Test Cluster’, keyspace ‘TravelData’, table ‘traveldetails’);

    Note: Tables names in your case are different.

Create a data source in Helical Insight

    1. Go to the location “C:\Helical Insight\hi-repository\System\Drivers” and add hive JDBC4 jar

    Download the hive jar, to download jar click here

    Note: Location may vary based on the HI Installation directory

    2.Go to datasource create page

    3.select the managed datasource

    4.Give the datasource name

    5.Select driver name as org.apache.hive.jdbc.HiveDriver

    6.Enter hive url in URL input box

    7.Enter username in username input box

    8.Enter password in password input box

    9.Test the connection

    10.If test successful save the datasource.

Creating the metadata in Helical Insight

    i. Here we have to create the metadata manually. Sample of the metadata file is provided below.

    Click here to download sample metadata

    ii.Edit this metadata file and find the connectionId and change the connection id to the datasource id.

    iii.Change the table names and column name as per your table names and column name with the appropriate type and default function based on field type and delete the unnecessary tables and columns.

    iv. Save this metadata in the hi-repository.

    Location: C:\Helical Insight\hi-repository\Cassandra Metadata


    Note: Location may vary based on the HI Installation directory

    v.Now Go to the metadata edit page.

    vi.Now select the metadata which we have created by double click on metadata.

    vii. Now you are on the metadata page where you can defile alies/joins/vies/security conditions.

    viii.Now save the metadata.

Creation of the Adhoc report

    i.Click on the Report and click on Create Report.

    Now it will open file-browser to select the metadata, select the metadata by double clicking on metadata.

    Now you are in the report create page where you can drag and drop column in the selection area to create report.

    iv.Save the report for the future use.

You May Also Like

Helical Insight’s self-service capabilities is one to reckon with. It allows you to simply drag and drop columns, add filters, apply aggregate functions if required, and create reports and dashboards on the fly. For advanced users, the self-service component has ability to add javascript, HTML, HTML5, CSS, CSS3 and AJAX. These customizations allow you to create dynamic reports and dashboards. You can also add new charts inside the self-service component, add new kind of aggregate functions and customize it using our APIs.
Helical Insight’s self-service capabilities is one to reckon with. It allows you to simply drag and drop columns, add filters, apply aggregate functions if required, and create reports and dashboards on the fly. For advanced users, the self-service component has ability to add javascript, HTML, HTML5, CSS, CSS3 and AJAX. These customizations allow you to create dynamic reports and dashboards. You can also add new charts inside the self-service component, add new kind of aggregate functions and customize it using our APIs.
Helical Insight, via simple browser based interface of Canned Reporting module, also allows to create pixel perfect printer friendly document kind of reports also like Invoice, P&L Statement, Balance sheet etc.
Helical Insight, via simple browser based interface of Canned Reporting module, also allows to create pixel perfect printer friendly document kind of reports also like Invoice, P&L Statement, Balance sheet etc.
If you have a product, built on any platform like Dot Net or Java or PHP or Ruby, you can easily embed Helical Insight within it using iFrames or webservices, for quick value add through instant visualization of data.
If you have a product, built on any platform like Dot Net or Java or PHP or Ruby, you can easily embed Helical Insight within it using iFrames or webservices, for quick value add through instant visualization of data.
Being a 100% browser-based BI tool, you can connect with your database and analyse across any location and device. There is no need to download or install heavy memory-consuming developer tools – All you need is a Browser application! We are battle-tested on most of the commonly used browsers.
Being a 100% browser-based BI tool, you can connect with your database and analyse across any location and device. There is no need to download or install heavy memory-consuming developer tools – All you need is a Browser application! We are battle-tested on most of the commonly used browsers.
We have organization level security where the Superadmin can create, delete and modify roles. Dashboards and reports can be added to that organization. This ensures multitenancy.
We have organization level security where the Superadmin can create, delete and modify roles. Dashboards and reports can be added to that organization. This ensures multitenancy.
We have organization level security where the Superadmin can create, delete and modify roles. Dashboards and reports can be added to that organization. This ensures multitenancy.
We have organization level security where the Superadmin can create, delete and modify roles. Dashboards and reports can be added to that organization. This ensures multitenancy.
A first-of-its-kind Open-Source BI framework, Helical Insight is completely API-driven. This allows you to add functionalities, including but not limited to adding a new exporting type, new datasource type, core functionality expansion, new charting in adhoc etc., at any place whenever you wish, using your own in-house developers.
A first-of-its-kind Open-Source BI framework, Helical Insight is completely API-driven. This allows you to add functionalities, including but not limited to adding a new exporting type, new datasource type, core functionality expansion, new charting in adhoc etc., at any place whenever you wish, using your own in-house developers.
It handles huge volumes of data effectively. Caching, Pagination, Load-Balancing and In-Memory not only provides you with amazing experience, but also and does not burden the database server more than required. Further effective use of computing power gives best performance and complex calculations even on the big data even with smaller machines for your personal use. Filtering, Sorting, Cube Analysis, Inter Panel Communication on the dashboards all at lightning speed. Thereby, making best open-source Business Intelligence solution in the market.
It handles huge volumes of data effectively. Caching, Pagination, Load-Balancing and In-Memory not only provides you with amazing experience, but also and does not burden the database server more than required. Further effective use of computing power gives best performance and complex calculations even on the big data even with smaller machines for your personal use. Filtering, Sorting, Cube Analysis, Inter Panel Communication on the dashboards all at lightning speed. Thereby, making best open-source Business Intelligence solution in the market.
With advance NLP algorithm, business users simply ask questions like, “show me sales of last quarter”, “average monthly sales of my products”. Let the application give the power to users without knowledge of query language or underlying data architecture
With advance NLP algorithm, business users simply ask questions like, “show me sales of last quarter”, “average monthly sales of my products”. Let the application give the power to users without knowledge of query language or underlying data architecture
Our application is compatible with almost all databases, be it RDBMS, or columnar database, or even flat files like spreadsheets or csv files. You can even connect to your own custom database via JDBC connection. Further, our database connection can be switched dynamically based on logged in users or its organization or other parameters. So, all your clients can use the same reports and dashboards without worrying about any data security breech.
Our application is compatible with almost all databases, be it RDBMS, or columnar database, or even flat files like spreadsheets or csv files. You can even connect to your own custom database via JDBC connection. Further, our database connection can be switched dynamically based on logged in users or its organization or other parameters. So, all your clients can use the same reports and dashboards without worrying about any data security breech.
Our application can be installed on an in-house server where you have full control of your data and its security. Or on cloud where it is accessible to larger audience without overheads and maintenance of the servers. One solution that works for all.
Our application can be installed on an in-house server where you have full control of your data and its security. Or on cloud where it is accessible to larger audience without overheads and maintenance of the servers. One solution that works for all.
Different companies have different business processes that the existing BI tools do not encompass. Helical Insight permits you to design your own workflows and specify what functional module of BI gets triggered
Different companies have different business processes that the existing BI tools do not encompass. Helical Insight permits you to design your own workflows and specify what functional module of BI gets triggered