Businesses

Kugu leverages Kafka for building management to migrate its legacy resources to AWS 

See the pain points and the success stories in Kafka for building management.  Discover how Kugu leveraged Kafka to automate its legacy resource migration to AWS, streamline operations, and enhance energy management.

Meet Kugu, a startup innovating in Kafka for building management.  

‘We’re an international team of techies, designers, and business wannabes’, Kugu’s website explains. Built in Germany, the company provides a scalable energy data platform for buildings, empowering property managers with valuable insights from IoT devices monitoring central heating, cooling, and air. 

However, as Kugu’s team aimed to expand its product and incorporate new features and data feeds, their existing system proved inadequate. To allow Kugu to scale seamlessly while accommodating future growth across Europe, the team needed a flexible data infrastructure. 

Before switching to AWS with security, Kugu’s team spent too much time managing legacy resources. 

When we met Kugu, the team wanted to make progress towards a global, carbon-free real estate sector. For the last two months, they had interviewed users and grasped, at a high level, what they wanted to build for the next iteration of their product. They wanted to expand beyond Germany to Poland, Austria, and France, and as they did so, map their data in real-time. 

But Kugu’s team faced a significant challenge: managing their legacy and on-premises resources consumed substantial time and effort. To focus on Kugu’s expansion, the team needed to automate and migrate its resources to a more scalable platform. 

Switching to AWS (Amazon Web Services) would allow Kugu to leverage scalable and flexible cloud infrastructure, helping their team store and process large amounts of energy data. Also, AWS had advanced analytics tools and machine learning capabilities that Kugu could use to gain insights from its energy data. 

Task: We needed to migrate Kugu’s resources to AWS with security 

At this point, Kugu’s primary goal was to automate the migration of its existing legacy and on-premises resources to AWS while ensuring the system remained secure. To accomplish the automation in Kafka, Kugu embarked on a comprehensive project with OSO to modernise its infrastructure and streamline its operations.

Actions: We successfully completed automation in Kafka and created microservices to speed up Kugu’s service 

After we evaluated Kugu’s technology requirements, we worked with the team to support their developers and automate as much of the process as possible. 

  1. First, to automate the migration process and ensure security, we implemented an automated deployment pipeline integrated with comprehensive testing mechanisms. This allowed us to seamlessly migrate and validate resources, reducing manual effort and minimising the risk of errors.
  2. Then we helped Kugu automate its infrastructure-as-code pipeline, enabling the provisioning and management of resources using code, resulting in faster and more consistent deployments. This saved us time and kept Kugu’s project cost-effective since we didn’t need to create resources manually in AWS.
  3. As an add-on, we developed multiple microservices to enhance Kugu’s system flexibility and modularity. These were designed to handle specific functionalities, making the system more scalable and efficient. By leveraging AWS services such as AWS Lambda and Amazon Elastic Container Service (ECS), Kugu could effectively manage and scale its microservices, ensuring smooth performance.
  4. Finally, to close out the project, we conducted load testing to validate the system’s capability to handle high volumes of data. Through simulating real-world scenarios and stressing the system, we identified potential bottlenecks and optimised Kugu’s applications accordingly. This helped us fine-tune their system for optimal performance, scalability, and reliability.

Before switching to AWS with security, Kugu’s team spent too much time managing legacy resources. 

When we met Kugu, the team wanted to make progress towards a global, carbon-free real estate sector. For the last two months, they had interviewed users and grasped, at a high level, what they wanted to build for the next iteration of their product. They wanted to expand beyond Germany to Poland, Austria, and France, and as they did so, map their data in real-time. 

But Kugu’s team faced a significant challenge: managing their legacy and on-premises resources consumed substantial time and effort. To focus on Kugu’s expansion, the team needed to automate and migrate its resources to a more scalable platform. 

Switching to AWS (Amazon Web Services) would allow Kugu to leverage scalable and flexible cloud infrastructure, helping their team store and process large amounts of energy data. Also, AWS had advanced analytics tools and machine learning capabilities that Kugu could use to gain insights from its energy data. 

Task: We needed to migrate Kugu’s resources to AWS with security 

At this point, Kugu’s primary goal was to automate the migration of its existing legacy and on-premises resources to AWS while ensuring the system remained secure. To accomplish the automation in Kafka, Kugu embarked on a comprehensive project with OSO to modernise its infrastructure and streamline its operations. 

Recap: The Kafka services Kugu chose to use for automation in real estate 

  • Automated Deployment Pipeline: Implementing an automated deployment pipeline integrated with rigorous testing mechanisms allowed Kugu to streamline its migration process. Automation with GitLab pipelines significantly reduced manual effort, minimized errors, and ensured that Kugu transitioned smoothly to the new platform.
  • Infrastructure-as-Code Automation: Adopting infrastructure-as-code principles accelerated Kugu’s resource provisioning and management. Automation also allowed for faster and more consistent deployments, eliminating the need to manually create resources and ensuring a better use of resources.
  • Microservices Architecture: Embracing a microservices approach, Kugu enhanced system flexibility and modularity. By leveraging AWS Lambda and Amazon Elastic Container Service (ECS), Kugu developed specialised microservices that improved scalability, efficiency, and overall performance.
  • Load Testing and Optimisation: Conducting rigorous load testing validated the system’s ability to handle high volumes of data. As part of this process, we simulated real-world scenarios, identifying potential bottlenecks and fine-tuning Kugu’s applications for optimal performance, scalability, and reliability.

Result: Kugu’s updated AWS with security platform handles 3 million IoT devices and processes 100,000,000 messages daily 

Together, the work OSO and Kugu did led to the successful automation of legacy resource migration, significantly reducing the team’s manual effort and streamlining operations. Now, Kugu’s platform boasts the capability to handle more than 3 million connected IoT devices and process over 100,000,000 messages daily. 

After automation in Kafka, Kugu’s new platform is flexible, scalable, and secure 

Migrating to the new platform also opened up avenues for Kugu’s team to be more efficient and effective in their daily work. The team had: 

  • More time for strategic thinking: Automating resource migration freed up valuable time and resources previously allocated to manual management, enabling Kugu’s team to focus on strategic initiatives and expedite their digital transformation.
  • Increased agility: Adopting microservices architecture empowered Kugu with flexibility and scalability. The modular approach allowed for easy integration of new features and facilitated agility in response to evolving market demands, reinforcing the company’s competitive edge.
  • Reinforced systems: Embracing AWS’s robust security measures fortified Kugu’s system integrity. The comprehensive security features provided by AWS, combined with Kafka for real estate, ensured encryption, access controls, and continuous monitoring to safeguard sensitive data. The migration to the cloud also improved Kugu’s ability to manage data, access information, and recover from unexpected disasters. 

Thanks to AWS with security, Kugu plans to expand product features and add international locations 

With the certainty that they can scale securely, Kugu’s team now intends to expand its product features based on the conversations they’ve had with their users. The team has already started to map out the features they want to add for each of their customer personas, from introducing historical data for building planners to improving how property managers can exchange data with their tenants.

In the next two years, the new platform will also allow Kugu to scale and expand to international locations. Kugu’s team is looking forward to launching pilots in Poland, Austria, and France, as well as expanding two of their most valuable products, submetering and central heating. 

After leveraging Kafka for real estate, Kugu is one step closer to reaching carbon neutrality in Europe

Kugu’s successful migration not only provided additional security but also transformed its operations. By automating its legacy resource migration to AWS and embracing advanced technologies, the team achieved scalability, maximised efficiency, and enhanced data management. Plus, Kugu’s commitment to a greener future aligns with its mission of contributing to a carbon-neutral real estate sector in Europe. 

Congratulations, Kugu! 

Kafka for Real Estate has proven to be a game-changer for Kugu, a startup dedicated to revolutionizing the energy management landscape in the real estate industry. By leveraging Kafka’s capabilities and partnering with OSO, Kugu successfully automated its legacy resource migration to AWS, paving the way for a more scalable, secure, and efficient platform. Through the adoption of an automated deployment pipeline, infrastructure-as-code automation, and a microservices architecture, Kugu experienced significant improvements in system flexibility, modularity, and performance. Load testing and optimization further solidified the platform’s ability to handle massive volumes of data, making it capable of managing over 3 million IoT devices and processing more than 100 million messages daily. As Kugu expands its product features and prepares to enter international markets, the updated AWS platform, powered by Kafka for Real Estate, provides the necessary foundation for their continued success. This transformation not only empowers Kugu but also contributes to their mission of a carbon-neutral real estate sector in Europe. Congratulations to Kugu for their achievements in scalability and automation, and join them on their journey of innovation and growth with Kafka.

Book a free call with us

Are you at the crossroads of deciding whether to build an in-house Apache Kafka service capability or buy a solution? This downloadable white paper serves as your comprehensive guide to building your own Kafka service and empowering you to make an informed decision while fostering an outstanding developer experience.

Book a Call