Middleware Configuration in Helical Insight

Users need to configure connection of Apache Drill to use it as a middleware if they wish to connect to flat files and MongoDB via Apache Drill. Once Middleware configuration is done, users will be able to see icons of the flat files on the Data Sources page. The Apache drill must be installed and started in order to configure it as a middleware. Below are the steps for the configuration:

Step 1: Go to the Management tab on Homepage.

Middleware Configuration

Step 2: Click on Enable. This will enable the use of Drill as a Middleware via which users can connect to flat files (like CSV TSV Sequence Parquet etc) and MongoDB. After the option has been enabled, users will be able to see the icons of flat files and MongoDB on the Data Sources page.

Middleware Configuration image

On clicking Enable, the above screen will show.

Step 3: Click on More link above the URL. Insert the following details of the connection to the middleware:

  • Host: The IP address at which Drill is present.
  • Port: The web console port number of Drill to access it using browser/client tool. The default port number for Drill is 8047.
  • Database/User Port: The JDBC connection port for Drill. For Drill, default is 31010.
  • Extra Parameters: Extra configuration that needs to be part of the JDBC URL. It is not mandatory.
  • Security Enabled: If your connection to the middleware requires username and password, toggle this button. Refer to step 4. Otherwise, the user can skip this step.
  • Distributed Mode: Helical Insight supports distributed mode of Apache Drill. If you are using Drill in this mode, toggle this button. Refer to step 5.

Middleware Distributed Mode

Step 4: Click on toggle button Security Enabled to enter username and password to connect to middleware.

  • Username: The username required to access the middleware.
  • Password: Password required to access the middleware corresponding to the username.
  • Security Check Type: The endpoint for form authentication. Default value is /j_security_check.
  • Security Mode: Type of security mechanism used by Apache Drill (such as plain, SPNEGO, MAP R etc.). By default, it is plain.

Security Mode

Step 5: If you are using Apache Drill in distributed mode, toggle the Distributed Mode button. You have to enter the details of the Zookeeper Port.

Distributed Mode

Step 6: If you are using an SSL/HTTPS to connect to the middleware, toggle the SSL/HTTPS button to green. This will update the URL and it will start with https://

SSL and HTTPS

Step 7: Enter the details of the Storage Implementation. Apache Drill has 3 types of implementation modes:

  • hdfs: Use hdfs storage to upload your flat files into Hadoop ecosystem. Hadoop should be up and running.
    • Hdfs Host is IP address of the name node server.
    • Hdfs Port is the data node port.
    • Data Warehouse Path will be created in Hadoop data node. The path should have read and write access.

    data warehouse path

  • sftp: Use SFTP when the Drill/middleware is installed on a separate server and Helical Insight is installed on a different Server. The files will be uploaded to the server where the drill is running. In case drill/middleware is installed in the Windows machine, please use Linux style path in Data Warehouse path. Example: /C:/Users/Helical/your/path/to/data warehouse

    • drill middleware

  • standalone: Use standalone when middleware and Helical Insight are installed on the same machine. The data warehouse path will be created inside the System directory of the hi-repository folder. All the files uploaded will be saved in that location.

standalone

Step 8: Click on Save to save the configuration.

For more information you can email on support@helicalinsight.com

You May Also Like

Helical Insight’s self-service capabilities is one to reckon with. It allows you to simply drag and drop columns, add filters, apply aggregate functions if required, and create reports and dashboards on the fly. For advanced users, the self-service component has ability to add javascript, HTML, HTML5, CSS, CSS3 and AJAX. These customizations allow you to create dynamic reports and dashboards. You can also add new charts inside the self-service component, add new kind of aggregate functions and customize it using our APIs.
Helical Insight’s self-service capabilities is one to reckon with. It allows you to simply drag and drop columns, add filters, apply aggregate functions if required, and create reports and dashboards on the fly. For advanced users, the self-service component has ability to add javascript, HTML, HTML5, CSS, CSS3 and AJAX. These customizations allow you to create dynamic reports and dashboards. You can also add new charts inside the self-service component, add new kind of aggregate functions and customize it using our APIs.
Helical Insight, via simple browser based interface of Canned Reporting module, also allows to create pixel perfect printer friendly document kind of reports also like Invoice, P&L Statement, Balance sheet etc.
Helical Insight, via simple browser based interface of Canned Reporting module, also allows to create pixel perfect printer friendly document kind of reports also like Invoice, P&L Statement, Balance sheet etc.
If you have a product, built on any platform like Dot Net or Java or PHP or Ruby, you can easily embed Helical Insight within it using iFrames or webservices, for quick value add through instant visualization of data.
If you have a product, built on any platform like Dot Net or Java or PHP or Ruby, you can easily embed Helical Insight within it using iFrames or webservices, for quick value add through instant visualization of data.
Being a 100% browser-based BI tool, you can connect with your database and analyse across any location and device. There is no need to download or install heavy memory-consuming developer tools – All you need is a Browser application! We are battle-tested on most of the commonly used browsers.
Being a 100% browser-based BI tool, you can connect with your database and analyse across any location and device. There is no need to download or install heavy memory-consuming developer tools – All you need is a Browser application! We are battle-tested on most of the commonly used browsers.
We have organization level security where the Superadmin can create, delete and modify roles. Dashboards and reports can be added to that organization. This ensures multitenancy.
We have organization level security where the Superadmin can create, delete and modify roles. Dashboards and reports can be added to that organization. This ensures multitenancy.
We have organization level security where the Superadmin can create, delete and modify roles. Dashboards and reports can be added to that organization. This ensures multitenancy.
We have organization level security where the Superadmin can create, delete and modify roles. Dashboards and reports can be added to that organization. This ensures multitenancy.
A first-of-its-kind Open-Source BI framework, Helical Insight is completely API-driven. This allows you to add functionalities, including but not limited to adding a new exporting type, new datasource type, core functionality expansion, new charting in adhoc etc., at any place whenever you wish, using your own in-house developers.
A first-of-its-kind Open-Source BI framework, Helical Insight is completely API-driven. This allows you to add functionalities, including but not limited to adding a new exporting type, new datasource type, core functionality expansion, new charting in adhoc etc., at any place whenever you wish, using your own in-house developers.
It handles huge volumes of data effectively. Caching, Pagination, Load-Balancing and In-Memory not only provides you with amazing experience, but also and does not burden the database server more than required. Further effective use of computing power gives best performance and complex calculations even on the big data even with smaller machines for your personal use. Filtering, Sorting, Cube Analysis, Inter Panel Communication on the dashboards all at lightning speed. Thereby, making best open-source Business Intelligence solution in the market.
It handles huge volumes of data effectively. Caching, Pagination, Load-Balancing and In-Memory not only provides you with amazing experience, but also and does not burden the database server more than required. Further effective use of computing power gives best performance and complex calculations even on the big data even with smaller machines for your personal use. Filtering, Sorting, Cube Analysis, Inter Panel Communication on the dashboards all at lightning speed. Thereby, making best open-source Business Intelligence solution in the market.
With advance NLP algorithm, business users simply ask questions like, “show me sales of last quarter”, “average monthly sales of my products”. Let the application give the power to users without knowledge of query language or underlying data architecture
With advance NLP algorithm, business users simply ask questions like, “show me sales of last quarter”, “average monthly sales of my products”. Let the application give the power to users without knowledge of query language or underlying data architecture
Our application is compatible with almost all databases, be it RDBMS, or columnar database, or even flat files like spreadsheets or csv files. You can even connect to your own custom database via JDBC connection. Further, our database connection can be switched dynamically based on logged in users or its organization or other parameters. So, all your clients can use the same reports and dashboards without worrying about any data security breech.
Our application is compatible with almost all databases, be it RDBMS, or columnar database, or even flat files like spreadsheets or csv files. You can even connect to your own custom database via JDBC connection. Further, our database connection can be switched dynamically based on logged in users or its organization or other parameters. So, all your clients can use the same reports and dashboards without worrying about any data security breech.
Our application can be installed on an in-house server where you have full control of your data and its security. Or on cloud where it is accessible to larger audience without overheads and maintenance of the servers. One solution that works for all.
Our application can be installed on an in-house server where you have full control of your data and its security. Or on cloud where it is accessible to larger audience without overheads and maintenance of the servers. One solution that works for all.
Different companies have different business processes that the existing BI tools do not encompass. Helical Insight permits you to design your own workflows and specify what functional module of BI gets triggered
Different companies have different business processes that the existing BI tools do not encompass. Helical Insight permits you to design your own workflows and specify what functional module of BI gets triggered