Dive into one of the assignments:
A highly available, high-traffic visuals resize and optimise service
Our clients are experts in providing the best holidays and for promotion, they use various visuals. We are currently using a cloud service called Cloudinary to have a proper hosting platform with all visual optimisation options. This functions well but is a relatively expensive solution and we also store all visuals in our Google Cloud Storage Buckets. You are the one who can build a custom solution based on open-source technologies utilising Google Cloud and our software.
Load and performance testing platform integrated into CI/CD
We have advanced CI/CD pipelines that currently are running in Jenkins and we are working on a migration to Tekton, a cloud-native solution. These pipelines release our software in several environments and with each move, it runs a couple of steps, such as compiling software, testing it, checking for code conventions, etc. However, we are missing, automated performance and load tests as part of those steps. Whenever we make changes to our codebase, we want to ensure that we at least do not slow down or lose capacity. You will work on integrating a test suite, record the results and build up statistics.
Intrusion and anomaly detection with Machine Learning
Our SaaS platform is well-secured, as part of that security, we log a lot of information about incoming requests, output in consoles, application logs, etc. We believe that we can enrich this data by detecting trends, anomalies, or any other suspicious behaviour. You as a data engineer dive into the existing data and design a model and possibly other remarkable ideas that we come up with along the way.
Handling confidential data for new and existing clients
Throughout our platform, we maintain a lot of confidential data. Most of them are passwords and API keys. This is safely secured from Git or any other plain text source. However, this also has a downside. For every new client, we manually need to configure all confidential data and store them in Kubernetes, our orchestration platform. We would like to automate this process of onboarding and also make the confidential data accessible for our developers based on their access requirements.
What about your ideas?
We have shared several projects that the Maxxton team has come up with but there is no limit to this, by any means. If you have any exciting, innovative, brilliant ideas, you are more than welcome to share these with us over a cup of coffee. You are good to go together with Maxxton!