The Client:
Our client is a comprehensive business intelligence platform Tellius that enables users to process data quickly to make analytical decisions. This big data platform is designed to improve the customer's data
experience, simplify data processing and visualisation, and use intelligent automation to accelerate the journey from data to decision-making. Tellius is used in a variety of industries, including financial services, pharmaceuticals and life sciences, retail, healthcare, and high-tech.
Improving SaaS Big Data Platform for Analytics Performance
The Business and Technical Challenges:
-
Tracing the requests of the big data platform users.
-
Upgrading the technological stack.
The Solution:
The customer used an existing OpenTelemetry solution, which needed to be more flexible and complex enough for the project. Our engineers architected a new solution with usable data tracing and integrated it into different parts of the Tellius platform.
The Tech Stack Used in the Project:
-
Apache Spark
-
Scala
-
Mongodb
-
AKKA HTTP
The Result:
Our engineers accelerated the performance of the existing system. To identify the platform's bottlenecks, they created a solution for tracing
user requests. Then, they integrated this solution into most parts of the platform, which made it possible to track and filter user requests from the very beginning to the response.