Harnessing the Power of Now With Real-Time Analytics with Zuzanna Stamirowska & Hélène Stanway

So let's think about real time and logistics, We're not that millisecond, you know, engines blowing up or level. But still, we want to know, as soon as possible, because as the data comes in, like some intervals, we want to know that, let's say, box of vaccines is about to get spoiled because it was just forgotten somewhere site, right?

So. I mean, generally speaking, I would say ideally we're like sub seconds to say really real time and milliseconds in the critical cases.

Richie Cotton: Okay. That's quite a broad range. And then I can certainly see how you don't want to wait several seconds if you're on a Formula One track and then find out your engine's exploded. But yeah, certainly I like the idea of it just being faster than an analyst because very often with data science, you know, you ask someone a question and they don't Come back with an answer a week later and that's very much not real time.

Okay so I'd love to talk a bit about use cases and who's making use of real time analytics. You gave a few examples there. Helene, can you just expand on this? Like, where have you seen real time analytics being used?

Helene: So to give context, so I work in the insurance industry, which is traditional in many, many aspects. But what is really, really fascinating for me is that the client base that we as an industry underwrite and ensure and risk manage is moving at a faster pace than the insurance industry can deliver changes in insurance products and services , to cater for that.

That having been said. The client base is also knowing their risk much better than us as an industry. And it's from a use case perspective, we're seeing it across the board where there are fixed assets. I say fixed, it could be a ship that moves, right? It could be a building, it could be anything that is moving.

 A tangible asset and it's being used across the board. And I really liked example earlier around the vaccines. So one such use case is how do you monitor the temperature and condition of vaccines as they go through from production right through into the arm? So where in the value chain was it failing from a temperature perspective?

And two things from that one is actually I need to send some more vaccines down the same pipe down the same supply chain So that you can get individuals, vaccinated But actually is it always? failing at one particular point. Do we need to go and change the freezer? I'm being simplistic in my example, but do we need to change the freezer?

Do we need to do something else? So there's a whole bunch of examples. And actually, again, just going back to the real time original question as insurers, we probably don't need real time, real time, because if a tap is dripping, it's probably going to drip for a little bit before we perhaps need to think about sending a plumber in for it to not be a flood.

But there's, so many use cases and One of the ways that we drive and create use cases in the industry is actually looking at where there's been a claim. So where something bad has happened, could a sensor and therefore real time data have prevented or mitigated or made it not quite as bad as it ended up being.

So , there's a whole plethora of use cases, but the ones I'm most familiar with are in ships, in commercial properties and also supply chain. 

Richie Cotton: That's really interesting. And I have to say, I don't generally think of the insurance industry as being, really cutting edge in terms of, analytics and how fast like wanting to do things quickly. So it's interesting that even in insurance, there are these very important use cases. So it sounds like supply chain is an incredibly big use case and that goes beyond insurance.

That's like almost any company with physical products needs to worry about this stuff. So that's really interesting. Susanna, have you seen any other examples of where real time analytics is important?

Zuzanna: Absolutely. So when we're talking about the critical use cases the financial sector supplies a wide variety of those. So. Everything that's linked to trading or pretty much your competitive advantage is the ability to make a better decision faster. Like this is pretty much where you want to shave off latency.

The classical is of course, product action on credit card transactions. Right? You're there at the counter. You can't wait with the shop assistant. And they're like shaving off, let's say, two milliseconds in terms of latency worth everything. Actually, I can't say much more about this, but pathways being used by NATO.

You can imagine that there are many critical, let's say, time sensitive decisions to be made in a larger context. of operations. Concerns are some of the most critical ones. And then actually we do know pretty well everything that's linked to moving assets and physical assets. And it's true, like, there's a number of things.

There is the anomaly detection on the process itself, where perhaps it's not milliseconds, but still latency matters because, you know, this package of vaccines can be very important. Very precious. And indeed, any sort of process analytics that are being done to enhance them where you can. That's true.

It's actually, I'd say, a certain scale of use cases and latencies that you would require. It can also inform your technological choices.

Richie Cotton: And it seems like there's a sort of common thread there that anomaly detection is incredibly important because you want to find out and Helene, you also manage risk management. So, the idea that spotting bad things fast is going to prevent bigger problems further down the line.

I think, yeah, the fraud detection example, that's relevant to just many businesses around the world. I'd like to hear some success stories. Like, I don't know whether you can provide examples from a specific client, maybe more generally, just what sort of benefit can you expect from adopting real time analytics?

Helene: We worked with an industrial bakery whereby they were making the buns for a very well known global franchise of burger chains. And we deployed a number of different sensors and therefore real time data off the back of those sensors looking at how to optimize the operations and how to risk manage better.

And one of my favorite sayings about internet thing, sensor data, is it's going to tell us something we don't know. Because when you go around factory or whatever it is as a human, there are certain things that you can physically see, but of course there are certain things that you can't see. When we deployed the devices and used the data, we were able to see that the HVAC, so the air conditioning unit, was running at 95 percent humidity.

That's not good, can I just say. And we I told the factory that this was an issue and you would be so surprised to know they did absolutely nothing about it. Now why this is interesting for me in multiple different ways is that, This is all about the data telling you something and actioning off the back of it.

So guess what, go in and fix it because it's probably going to be quicker and it's going to be cheaper if you fix it. I said they didn't fix it, they didn't fix it and the whole thing went and they had to replace the entire unit. So what would have been a, I don't know, a 20, 30, 000 euro loss ended up being 150, 000 plus they had to stop the production line.

So it was what we call consequent business interruption. So the quicker you go in and fix these type of things, the better, least damage. The other thing that was a little bit scary was there was a particle detection sensor that was on their production line. They didn't know that it was being switched off for two hours every day.

So can you imagine, again, you've got these bums going through, could have little bits of metal in all sorts of things like that. And that's obviously going into human consumption. And you have the potential for what they call loss. So Again, I go back to that source of senses plus data plus behavioral change, and the quicker that you do that, the least impact that you have.

And everybody, nobody wants to have a claim, right? Nobody wants to have something happen. So can you actually use these more broadly and make a difference because you're reacting to data much, much more quickly?

Richie Cotton: That's a really interesting point that you can't just go and change your analytics stack, but then not change the processes as well. Cause otherwise you're not gonna be able to take advantage of it. Okay. So, maybe to be able to just talk about who needs to be involved in this.

 Suppose you see it goes, okay, we need to do real time analytics. Let's make it happen. Who needs to be involved in this transition? Which teams or roles need to be involved?

Zuzanna: Absolutely. I'd say that every time I've seen it work out the business units were heavily involved because the need usually comes from the business, from the use case, and pretty much they need to own it. But then there's the critical question of, what sort of technologies would we need depending on our latency requirements and functional requirements?

The traditional way of looking at the real time projects would be that, you'd have data scientists drafting a project, Let's say in Jupyter, but the intuition is that that would be batch, right? And then this is often given to somebody who would be a Flink expert or a real time expert.

That would be one person on the team whose job would be to translate this one into a real time setting, hoping that all the functionalities would carry through. This is usually not the case. Because actually the, real time stack has limitations in terms of what is possible to express.

And there are certain issues with consistency of how the results come back. So often translation is either difficult or makes the use case a bit crippled compared to what the data scientists designed. And then these are data engineers who usually translate the use case into real time. And then , this is being run, the pipeline is being run, right?

 and maintained for this case. So you usually have the business owner, let's say the business of the use case. Data science is a data science team that designs the use case and the solution. And data engineers whose job is to make it work in real time. Now, there are actually smarter ways to do it.

 there are possibilities for data scientists to be designing for real time already, such that we would lose this moment of translation from batch to real time. Then real time becomes more like pressing a switch. Of course, there's the deployment question, but you pretty much can start working.

Even Jupyter is on real time data and have, the replay and data science work done on live data. If you wish, it's actually right now possible. So we're also observing a certain shift where data science people start to be getting into real time, just because they have to deal with updating, changing data.

And personally, by the way I rarely talk about real time. I like to talk just about the fact that every day is changing. So if you wish, we could push it to saying that every data is real time or every data is, you know, I say incremental because you have incremental changes that you need and updates that you need to take care of if you're dealing with a living system and it's not just, a historical analysis.

The big question is how to deal with data updates. And then making sure that they're taken into account. but in terms of teams, you have your data scientists, data engineering, and let's say some change management that is also happening right now at organizations. But for those who didn't have streaming talent before, this is a good news.

Because all of a sudden, because your entire data team, assuming they work in Python, they can actually deliver operational analytics that you care about. So they can deliver the ROIs How to protect your resources and make smarter decisions faster. Probably this is it. And then we've always seen like more and more of business people being involved.

Helene: Obviously, I agree with what you're saying. I think what's been quite interesting in the experiences I've had around data scientists and business people together is it's really rare to find a data scientist who also has not only deep data domain knowledge, but also business domain knowledge, that they understand sufficiently the use cases in order to deliver the business outcomes that are desired.

And so that kind of the ability to kind of Maybe have a translator type role between the two tweaks, but you know enough about each topic to be dangerous, not necessarily the depth, but more of that generalist skillset so that you can make those connections. And I think what was, super interesting for us, again, I'm in insurance, I'm at risk.

We had, different types of business stakeholders. So we had one that was an underwriter. So an underwriter is somebody who assesses the risk and puts a price on it. You then had a risk manager and they're the folks about risk engineering that go to sites , and see and so forth. And it was fascinating that the kind of conversation and dynamic between the two, because it's as much about translating the fire hose of data that you get, the noise.

to what are the insights and the interesting elements from the data that make sense for the use case. And I think we, had a sort of real time data around, I can't remember exactly, something like 300 data points every however many seconds. Only 60 of those were remotely interesting and satisfied the use case.

So again, you couldn't have had that outcome, A, without translators, in inverted commas, but also different business people looking at the different angles of the use case.

Richie Cotton: Yeah, it's a perennial challenge I think is getting data people to talk to business people. It's something we worry a lot about on this show.

Zuzanna: Actually, could I comment on this? Because I've seen it play out wonderfully. I'd actually, one of our customers was like a more traditional one. But this goes back to their entire digital transformation. So at a certain point, they took people from operations and upskilled them to data science.

Helene: I see. I'm sorry, I'm not

Zuzanna: Which means that they came and they are able to go to, let's say the youngsters and operations right now and say, sorry, I know how this is being delivered, or I know how this process works, right? So I know how to optimize it. And come with just such an authority and knowledge when it comes to really operations and what matters.

It actually works and they can innovate, right? Very fast.

Richie Cotton: That's brilliant. I love the idea of just taking your business people, your operations people, giving them some data skills, and then suddenly magic happens. Yeah, it's a wonderful story. All right. I think both of you agreed that if you're going to do this right, you need some data people, you need some infrastructure people, you need some business people, and that leads to a question of like, which one of your executives needs to be in charge?

Is it going to be like your chief data officer, your chief information officer, your chief revenue officer, Who is going to be the person accountable for running a real time analytics program?

Zuzanna: In practice, I've usually seen the cheap data officer. Actually, the more successful ones are driven by business units that have the thing. But it depends sometimes on what sort of ambition the company has. So there are beautiful examples of companies that just move to real time.

They move to real time data warehouse. you're moving out of Oracle and you could possibly just have your data warehouse organized in Kafka. And we have like, even though we're not, you know, in this critical latency type of business you just assume that all data is flowing and you have your data warehouse, right?

And then this is pretty much a CAO who makes the decision. So these are the big ones where we're more about constructing the full stack, and this is where, of course, this is driven by the CIO and CDOs. But then often the way we see real time, you know, sneaking into organizations is really more the business units that have the pain.

It's like, I'm losing this much money because I don't know how to react. I'm operating in the blind, right? On this or that use case.

Richie Cotton: Okay, so it's going to be your business units or your business leaders that request this, and then it's going to be between the data team and the IT team to figure out how to implement it.

Zuzanna: This is where we usually see it happening faster, unless there is a full transformation of the stack. And also we believe that it's in a way smarter. To look up the use case and deliver the use case, especially right now, and speed matters also for the market share that are available as LLMs, right? We at Pathway believe that almost every pipeline will become an LLM pipeline in the future, as we used to be plugging ML models in the pipelines.

I mean, right now we'll be plugging LLMs more and more. And the speed of adoption matters a lot. Many rules of the game are broken. And they're being reinvented right now. So we're looking at actually people re delivering use case by use case, assuring adoption as well with the business users rather than waiting, you know, 10 years for a stack to be built.

So if you think I'm exaggerating with the 10 years, but it was also like the go to market strategy of Snowflake instead of, offering big data warehouse, it will take you millions business divisions were able to get going with their data, you know, from day one Paying easily.

Richie Cotton: I can certainly see how ripping everything out and going, okay, we're going to start again with a new data warehouse on a whole company level is difficult. So maybe doing it one business unit at a time is easier. Sorry Helene, you wanted to add to that?

Helene: Yeah, I was going to kind of build on that comment. Some of those absolutely resonate with me as well. And it's either where the biggest problem to solve is, or those that are more excited about trying to do something differently. Yes, if you've got big data technology, digital transformation strategy, but sometimes almost the steps before you get there are who is most excited to do something differently is that again, I'm bringing that human element in.

They're willing to experiment, they're willing to get things wrong. They're willing to drive and learn what the benefits are that may not necessarily be obvious if it's something completely new, right? What is real time data? What, are the benefits? Well, go learn, go investigate, go trial. And then from a culture perspective that kind of creates a bit of FOMO, potentially, fear of missing out.

Of like, oh, hold on a minute, that team over there has managed to do that. And that's when you then can kind of elevate it potentially into being much, much more of a big transformation. But sometimes starting small, experimenting, learning. with the right people and the right attitudes, then you can drive that broader scale.

Um, Because, of my mantras, often say, , we don't have a tech or data problem, we have an adoption problem. So, how do you get people to want to learn to upskill, to your point previously? How do you get people to want to do things differently?

Because it's very easy to stay in a little comfort zone bubble particularly if you're making money, why change?

Richie Cotton: Do you want to expand on that? do you have any tips for how you can get people to adopt new technology and techniques and actually go about doing the upscaling to make sure they can take advantage of new technology?

Helene: It's about the relationships that you build within the business and who you know, who are those people that are going to queue up right at 6 a. m. when Apple open their doors because they're launching a new iPhone. Find those people because they're interested in dynamic anyway, and they're willing, they have that personality type that want to do something differently.

I remember having a conversation with my board one time where, I actually ended up doing a very, very bad job. big piece of work with quite a small team with significant benefits. And my boss said, why did you work with that team? They're tiny. Why didn't you work with this team? They've got a much, much bigger revenue.

And it's a bit like they didn't want to, so find the people, those gems of people in your organization. that have already got that right attitude and want, to try something different. Because it's a real hard slog sometimes if it's the bigger team or the bigger thing, and they're just like, no, we're making money.

We don't need to do anything different. Find the pockets and then drive even more benefit. And that's when you get kind of drive excitement and use new stories and, benefits. And then you get something that's kind of that ground up swell of excitement within an organization.

Richie Cotton: I love that idea. Just find your early adopters, find your champions, and they're gonna generate some excitement and hopefully can spread across to the rest of your organization. so I'd like to know what's a good first project? You mentioned it's probably going to be one business division at a time or one team at a time.

Are there any sort of Easy or common, like simple real time projects that you might want to take on first.

Zuzanna: Absolutely. It may depend a bit on the adoption strategy that you have, of course. So there is one way that we show depending on whom you're approaching who wants to adopt. It may be the tech teams or it may be the business teams, right? So in the case of business teams, the easiest ones to test start, doing things on their own.

It's anything linked to logs. Logs monitoring, right? Anomaly detection, pretty much management of your own work. That is very fast, easy actually to test. And this is lovely. But then with business units, well, the question is where it's biggest pain, And, well, right now we actually do live , in the AI world.

So these are projects that can very quickly resolve issues of people and pretty massively like deep trust frustrations that we've seen. But the one that we really like it's anything that's linked to productivity, which is people actually see the productivity gain and some of their frustrations are being taken away.

And then of course there's an ROI behind it. Immediately because, you know, if you have for example, 47 percent of digital workers who claim they are wasting time on just finding information. Then assume you save like one hour per week for them at the level of, let's say, Ericsson. Thank you, sir.

Big tens of millions, right? Just, this. And I think one hour for searching for information an underestimate on how much , we're actually wasting. So the case that we really like resonates well, doesn't scream real time. However, you do have real time updates and all the documents and your knowledge bases and stuff.

 Hence, you actually need to be able to manage this. And the one that we like is certain slides. But, you know, I'm Bob. And then, you know, I think that Alice had this slide about a user growth maybe, or maybe somebody on her team. And I don't know what it word that there was some sort of conference, how they find it, and maybe there were other versions, right?

And I need it right now for my work. And the usual chain would be, would go and ask kind Alice. Alice would scratch her head. She would say, no, it was Katie, you, no ask her, maybe it was her collaborator. And then he would go and, run around like a chicken rub head and try to find that one, data point or to speed up your work.

And., with a nice right now system that combines LLAMs with updates, like all the nice indexing, you can get what you want immediately. And that's a very nice use case, which leverages the fact that data is changing private data sets. And such a way that it's immediately fixes your life.

So it's maybe one example that actually we at Pathway see right now. A lot. It's a simple one. And I need this. we built it because I needed it. I imagine like everybody can need it in a way or needed it in their life. So maybe the larger story here is just find the use case. That's just so obvious that it's, resolving real pain.

And then, of course, you move to big pipelines, then it's a bit easier to show ROI because sometimes , you can link the ROI to latency gain which is an obvious case and for detection in certain cases for detection, even opening revenue streams. of course, you know, explaining things with money makes it way easier.

Richie Cotton: , I like that idea of just starting with thinking, where am I wasting time at work and what's annoying me? And those are the cases where you need to get faster and optimize things. Alright Elaine, do you have any more examples of good easier projects to get started with?

Helene: I think about. So Susanna had some fantastic examples there, which are perhaps more internally focused. Absolutely brilliant. But there's also the external lens. So two way, one is who are your competitors and what are they doing? And do you need to keep up or go faster? But also what are the demands of the client base that you're serving?

So are they wanting more from you? Are they asking questions that, you know, to your point Susanna, Oh my God, it's going to take me three hours to answer this, but you need to answer those questions much, much more quickly. So often those external drivers from your client base make meaningful impact. I mean, the best projects I did were because a client wanted me to do something differently, and I could then go internally and go, Hey.

 we're going to lose this business if we don't do this, this and this. So, you have to be a bit of a hustler, I think, in some, you know, go hustle for the use cases, hustle for, the doors that are going to be slightly open that you can push open a bit more. So yeah, always client base and also competition.

So see who's doing what to drive forward.

Zuzanna: I'd say it's a lot about the market share. So if you're worried about your market share, you can, lose it not responding to customers, or you can lose it just because you're unable to automate and move as fast as your competitors, so both internal and external. And this actually glues very nicely with AI.

I mean, if you're able to make better decisions faster and, serve your customers faster and better, then you're probably winning.

Richie Cotton: I think that's just incredibly important competitive advantage. Just being able to do things more efficiently and faster than your competitors. So yeah, that seems like a good sort of heuristic for deciding what projects to take on.

Helene: Oh, I challenge that a little bit.

Richie Cotton: Ooh, okay.

Helene: just speed, but it's the informed decision making at speed, I think. So can you make better, more informed decisions quicker than your competitors? Speed, speed, speed. if you're telling them a rubbish answer, I could quite easily say no to you. And that's really quick and I've not had put any thought into that.

Whereas actually, if I can come up with something really informed, you need to do this, this and this, and this would make you safer, drive better, whatever for you. I think it's the informed decision making at speed.

Richie Cotton: Actually, that's true. I can always write a data analysis that gives the wrong answer in like zero, zero seconds.

Zuzanna: Of

Richie Cotton: Actually this leads to a tricky question for you. How do you go from, okay, we've got a real time analytics capability to we're making good decisions in real time. Elaine, since since you brought this up, this one's for you.

Helene: That's my payback, isn't it for challenging you. That's quite, that is quite tricky because when you start small and obviously need to scale, you then start hitting, you probably need business model change as well. , so I'll give you a good example of this with an insurance within, if you're wanting to put a price on how much the insurance should be premium wise for a building, you look at what typically are static data points.

So you look at how old the building is, what it's made of, how many stories it's got, where it is, bloody blah. That doesn't change every five minutes, does it? Whereas now, because buildings have so many sensors and it's, Constantly giving you data about the building, how, you know, you will go into meteorism because it's too cold or too hot and we're changing the temperature all those sorts of things, actually that starts to make a difference.

Building occupancy indoor air quality, all sorts of things within the building. It is really difficult for a, And actually to change their pricing model from six or seven, however many data points for premium 60 plus data points, every second, a few minutes, really, really difficult. There is one organization that's done it and they have driven so much more profitability because they made the business model change.

Cause otherwise it just stays as a surface. or we're tinkering with it to driving real, business value because they're able to put the construct around being able to use the data and make those, as we talked about a moment ago, there's better, more informed decisions with better pricing that's more pertinent to that risk, because they've got more information.

Richie Cotton: Okay, so I think this is back to, we need the data teams to talk to the business teams again, because what are the business teams going to do with all that new data that they now have? Alright, so maybe we'll break this down. I think I promised we were going to talk more about processes beforehand.

So, Susanna, do you want to talk through what some of the process changes are going to be? So once you've got this real time analytics capability, how do you change your processes in order to get these new business models or otherwise take advantage of the technology?

Zuzanna: course, I mean, I would reverse it a bit and I would start the case like the entire real time case from the business questions and needs that are there, then it's way easier because technology responds to an actual business use case, right? So it depends again, who's driving it, if it's being driven by the tech divisions or it's being driven by the , business people who own the use case.

It is a bit easier when there is a business leader who knows, okay, we need to change our business models to become more competitive. And let's, for example, try to adjust pricing and how we do it is like going down and down in the text I can doing this, if I know maybe we need Kafka, maybe we don't need Kafka, we can just have a fast as pre and then, smart analytics and stuff.

So I would actually normally reverse the thinking and not say, okay, now I have real time. So what do I do about this? I would rather. Think about what I want to accomplish and then go down the real time path. One thing to remember is that real time is not as scary as it used to be. As many people thought, okay, I can't afford having, for example, I know real time pricing because that would be extremely expensive and I'm not even sure if I would ever get into it.

And then talent is difficult , to get them bored at the church. I mean, right now, this is not the case anymore. but in terms of process change, you have business models that are different normally it's driven by product people. So any time I've seen real time, being adopted, we often talk about business people who in the use case, but there are the product people actually drive the adoption and adjust the little elements.

For example, how information is delivered to make it useful. So we very often see that it's important to have a simple way of prototyping how insights are delivered to users and depending on their level and their organization. and this is actually a very powerful tool , for data people who work on the use case is to find a way, okay, I'm not just doing my analysis, right?

But I need to find a way in which this Insight will be meaningful to the business user and depending on levels of users, it's maybe very different. so we talked about logistics a bit before, like imagine you have somebody who's running a warehouse and this time it's not a data warehouse, it is an actual warehouse, right?

That person probably doesn't need an interactive dashboard with thousands of different parameters. That person may actually need that's a text with an alert about the fact that, this sort of drug is going to arrive within two hours or not, because then there are some of the decisions that are to be made depending on this information.

But getting to this like level of granularity of how specific insights should be delivered to whom is actually a big thing. So there's a lot of usability elements also in the ways we can consume analytics and it links to real time. It's true for any data science. But it's especially true to real time because you have more dynamic ways , of delivering information like alerts.

And if your alerts , are bad, you will generate habits which are actually very, very negative because people will just start ignoring your alerts. And you need to make sure you're not generating false positives. Because then the entire real time system just, Doesn't make any sense. And it's, used to be actually a very big pain , of the real time technology that, it was tough to reach consistency.

 so we would kind of end up with a light that's just flashing, , like an alert light. then what do you see really is that it was smart to go with some sort of dashboard prototypes to business people can nail what sort of data is one thing, . but then insight is a completely different one.

And then , how we deliver the insight is like a third step. So first thing is like having a simple way to prototype this, including colors and usability, like a small thing of like, if you're able to share your link to your dashboard and the dashboard stays the same with all the filters. 

This is extremely useful because he has shared it with a colleague and just say, Hey, listen, like this is wrong, or something is up, what can we do? Or you shared it with your boss, you have the report. this actually speeds up things enormously and a very, very simple thing. And once you get this, you can optimize, other ways in which you deliver.

Like I mentioned, text, slack alerts, like whatever is used really in the organization. to be able to consume the outputs of real time system. This is for the somehow human in the loop scenarios, of course. There are many non human in the loop scenarios. But then we would be talking, you know, for the textual trading, etc.

Richie Cotton: I like the idea of just going beyond of the output of the analytics as a dashboard. Actually, sometimes people want a little yeah, just sending him a text or message, well, plenty of different messaging systems, but just getting the insights to people where they need it immediately in a simple format that can be very powerful.

 we talked a bit about how processes can change. I'd also like to talk about how does organizational structure change? So do you need. A different team setup.

Zuzanna: I'd say if I can take it for, really for real time, talking from infrastructure kind of data and infrastructure perspective. There's a strong trend that we're seeing right now. Like so called modern data teams where data engineering is disappearing. So we're actually having, let's say, full stack data people and actually have to merge software engineering with data skills. then, of course, you would have DevOps, you would have people for deployment, etc. But the more modern teams that you would see out there right now, and let's say the digital native companies, Start to just, know, not having data engineers as a separate. The assumption is that if you're, if you're actually especially true with AI, because you need to be able to control the pipeline, because any small change at any step of the pipeline can actually impact the way your model is operating. So you need to be able to have, an end to end view and control , over the deployment. So the data engineers. I don't need to connect app skill or like stay in specific use cases. This is one thing that we see and then there is a bigger shift which is happening, of course, right now with LLens.

So LLens are adopted mostly by the data teams or there are new teams being created, right? It's a bit shaky still because everybody needs to adopt but it's very disruptive, in fact, to the way the organization working. And here, you know, you're merging, like, all this goes together. But in the end, it's a question, okay, who's delivering the pipeline?

Who is responsible for this pipeline? Who's responsible not just for the pipeline to work and who's getting the calls in the middle of the night that, hey, , it's, broken which would be the data engineer's old job sometimes. But right now it's, more about, is this model drifting, right?

Who's taking , responsibility for the output of the models? And this is becoming a bit tricky in terms of how integrated teams need to be. At this stage

Richie Cotton: that's interesting that data engineering and software engineering are merging I guess because there's a lot of software involved in building these pipelines. I'm curious as to whether the data analyst role is changing as well. Like, is a real time data analyst different from a regular traditional data analyst?

Is that job changing?

Helene: can't answer that question, but I'm just reflecting on what Susannah said, because I had in my head that by having real time data, you, in some respects, need to be more specialist. But actually, when I listen to Susanna, it sounds like your teams are becoming more generalist, as in, they need to know more than, one thing.

Or as I had in my head, actually, because you've now got greater insight, it becomes much more of an ecosystem from an organizational perspective, where you have more specialist roles, actually. So it is really interesting, kind of that contrast of, how do you get the data?

How do you get the insight? And then what do you do from a behavioural perspective once you've got the insights? So I saw that, sort of those series of roles because to your point, when somebody sends an alert in my world, it would be a tap drip. So I need to go and get a plumber. Well, that's not an insurer.

That's a very specialist role or your temperature starts to get too hot. You're going to again, send an electrician in, for example. So I had it in my head that it was an ecosystem with specialisation, but I'm really interested

Zuzanna: for how you act on the information, of course, because then it impacts the business roles. But as for the data team, let's say how it was designed right now. This is pretty much so it's even the thing of 2023 more than 2024. The rise of the modern data teams. And LLMs are changing this adding yet another layer the level of even complexity.

just becoming different. I think in many ways it's becoming easier because tooling evolved. Indeed, back in the days we'd have one, two people specialized in streaming. I can take a case of like one of the F1 racing teams, right? So there would be, in the past let's say, some dedicated folks to streaming and others would be doing batch analytics.

Thanks. If all of a sudden everybody can just do things in real time from day one, it's just way easier and cheaper, right? But before, real time data pipelines were pretty hermetic, also for just technical reasons. Or I call it linguistic because it's a question of language, right? There was no lingua franca between batch and real time.

Real time is traditionally more built in Java and like sort of technologies, whereas the dominant language for data scientists, data analysts is Python uh, and SQL, right? But especially right now with AI common, we have to, be working in Python. This is, this is like the one thing we need to be doing.

Of course, Python is not dramatically efficient. So making it real time is actually pretty funny. Of course, it's not Python that starts to run in real time. There are ways to allow people, data analysts, data scientists to work with Python. Python and still making it run in real time is actually one of the things we did at Pathway.

the engine is written in Rust, and then everything is being executed on the Rust engine, which speeds things up. But the interface, the way one interacts with real time pipelines is in Python. So you can code your thing in Python. it's nice, and I'd say fluffy in a certain way, or customary for the data professionals.

But then you get the speed and you get the ability to actually. Run in real time. But it's not just as actually the thing about the data, modern data teams, something I've heard numerous times from some like the most innovative companies, of course, is there probably the scale ups, That are driving this. It's like, it's definitely not the case of Walmart for example, yet perhaps. Um,

Helene: Insurance because we're very old.

Zuzanna: uh, But. it is changing because sometimes you just need an external event to shake things up and the arrival of LLens started to kind of make it okay to break all the rules and data organization. All of a sudden, people, for example, who are afraid of bringing somebody in, getting help, like somebody would be saying, no, I'm building a big stack and I have a plan for five years, and they're like, okay, I know what's happening.

We have to know where to make the bets, we need to move fast. So let's act and move faster. And then, yes, people need to be more aware of the full implications of the deployments. So both development and deployment. Because. Sorry, I'm biased towards LLAMs is like most of actually the user pathway right now is for LLAMs.

But , this is also something that we're going to be seeing everywhere. So you see now is that it's very tough to put such systems in production because of the disconnect between talent in a way, and sometimes an organization. And then also development of technology. It's pretty easy to make nice use case or like a prototype to test with users, which is great, but they need to put it at scale.

And this, includes data updates, real time data, This includes serving the model to the users, privacy, making sure that all of a sudden the answers that are, maybe should be restricted to the eyes of the CEO are not given to any employee because that would be tricky.

And all of this actually requires a sensitivity and like a way closer collaboration. Between different members of the data team. So, of course, there are still people who are more specialized in this than that, like who have better experience, but they should be actually merging more and more like software data skills.

And by data, I would extend it to LLMs including deployments.

Richie Cotton: so maybe a few people have to be go very deep on particular areas, but actually in general, everyone needs to learn a lot about several different roles. So lots more learning and upskilling for everyone. It sounds like.

Zuzanna: Yeah, but then you'll also get automation of certain tasks, so I will be able to perform them faster. So the second, let's say, part of LLMs is that we'll get certain tasks. It's being done faster or automated as the value will be in the ability to think systemic, like in terms of systems, right. Rather than going twice.

Richie Cotton: So I do love a good disaster story. So, I'd like to know what are the common mistakes organizations make when trying to adopt real time analytics? Helene, I'm sure you must have some good disaster stories from the insurance industry.

Helene: Oh, disaster stories. Surely those should be called learnings,

Richie Cotton: Yes lessons learned.

Helene: Lessons learned. I mean, for me, I, I kind of veer away from actually the data. It's all about the people. It's always all about the people. Getting the people to make sure that you get the right requirements, that you define the use case.

You get the people that are gonna actually want to be involved. We haven't talked about political capital. I mean, I've had so many failures from initiatives because the leader who was, championing it and so excited, then left the organization. And of course, a new leader doesn't want somebody else's idea.

They want to then build their own. So, unfortunately many, many things stopped because of that. So, Yeah, I can't really talk to kind of data specifics for me, I always, disasters are always around the people in the, in the broadest sense because you, you miss something, people don't like change or, what have you.

Richie Cotton: All right, so it sounds like the organizational side of things are very important. Like, make sure you do your planning properly, you've got a real use case, and you've got executive buy in. Okay Susannah, any more lessons learned?

Zuzanna: Yeah, I would agree with this, just generally speaking, I like use case first. Although of course, like sometimes you want to educate a bit, right. Especially when they, the team wants to educate the business and they would start them. So maybe, maybe it's a learning. Maybe it has to be happening just a certain point and breaks the wall.

actually, I'd say that especially, let's say two years ago, I've heard more horror stories about adopting real time data pipelines. then I heard like good stories. And it was mostly linked to the difficulty of getting, building the stack. and again, this depends on your definition of real time, because there's a question of being in the real time streaming data stack, like technological stack, this is one thing, and then there's just a question of having pretty much operational analytics or, you know, data flowing at latency that makes sense for your business.

I would separate those two. But it's true that getting into, for example, you know, the Kafka ecosystem, people are saying, I don't wanna babysit Kafka. I just was just talking with FinTech and said, we know Kafka very well. We know it so well. Percent for story, this Kafka. Some sort of message broker would be Kafka. the most traditional one. Then you have stream processing or some sort of framework to do analytics or to actually be able to process this data and get the output. and latency that you require.

And I'd say that I've seen people usually embarking on big projects that would last nine months and often fail. For numerous reasons, I mean, one would be, for example, trying to translate a use case, which was prototyped in batch into real time and running into just limitations of the streaming technology.

And this happened more often than not. Or folks who are trying to have a hybrid architecture and then that hybrid architecture, I mean, this is becoming so expensive to run and maintain. So you have some bits of real time, some bits of badger, like kind of doing both and then. With certain vendors, you're starting to do this, becomes prohibitive in terms of costs.

then, unfortunately, this goes back to the use case, right? Because the question is, okay, is it really affordable for us? I mean, it's so interesting from the business standpoint that we want to be doing it. So, of course, lowering complexity and lowering the costs opens up those use cases more easily.

Richie Cotton: Okay, so you really got to think about your tech stack before you spend a year building something new out and then discovering it doesn't work.

Zuzanna: Actually, right now there are nice possibilities. you don't need to get into Kafka, for example if you, if you want to have low latency analytics. I mean, for some people, it's enough to have a fast updating storage like a fast S3, and then plug in analytics framework, like us, actually.

And you still can get, in many cases, latency. Of course, it depends on what you're doing, but The point is you want your insights faster in many cases. You can probably just reduce this complexity by choosing a stack, which is a bit different still. And it's not streaming in the tech stack sense.

It still can be sort of streaming in just the way that it delivers a risk case.

Helene: I'd flip a couple of points around actually, and one of them is probably more specific because I'm in a very highly regulated environment but one of them is simple kind of innovation management. So one, regulation. So one of the things that actually enabled me to be successful was to bring a cross section of individuals from the organisation that were in the government's legal audit teams And we presented every single one of our pipeline and experiments before we kind of got into scale or anything like that to that group.

And it was very, very deliberately done because we wanted to hear every question from that group because some of it was new technology, new data points, real time data and so forth. And so they needed to know about it. straight away and learn from each other. So Audit might ask one question versus compliance versus blah, blah, blah.

So you were able to kind of build it by design to be compliant with the regulated needs that, that we had and that, Oh my God, we went slow, but we went so much faster as a result, and then the other one was simple stage gates, so you, you talk to Zara about kind of a nine month project. You may have had these, so.

I don't know, but just having a series of stage games, it must be able to do this before we're going to invest more time, money or resource into the next stage and being really deliberate about how you move from A to B to C to D and stop things that are not going to work far sooner. Because people get the site, we've got to deliver the use case.

Well, do you have points where is it still doing this? Do we need to pivot? And it's about bringing different kind of those innovation management. tools and techniques to bear that are different to project management, whether you're agile, wagile, waterfall or whatever else it is, actually having something a little bit more disciplined in terms of kind of those innovation structures to stop things much, much more quickly and therefore learn to stop them becoming real disasters.

Zuzanna: I mean, the nine months I was referring to is really from a technical perspective. And how long does it take you to write the code, pretty much. And surfing, it was traditionally the timeline.

Richie Cotton: All right. Yeah. So it does sound like again, we're back to like, really speak to a lot of people in your organization, make sure your plans make sense. And you've, you've got a way to exit the project gracefully if things aren't going as you planned. All right, super. So, just to wrap up what are you most excited about in the world of real time analytics?

Helene: So, I have recently started to learn about digital twins. So, all sorts and all manner of di different types of digital twins, which I think the exciting part for me is the visualisation of the data. And being able to manipulate it in a digital environment without affecting the physical thing that you're emulating in a, in a virtual way, but kind of the blend of IoT sensors, cloud technology, big data, every buzzword, we can play buzzword, bingo AI and kind of the metaverse, extended reality, bringing all those things together to create a visualization.

And you said something earlier, Susanna, that struck me when you were talking about the layout of a warehouse. So BMW have got a digital twin of their warehouse, which I've, I've had a look at, which is crazy clever, but even something as simple as if a worker moves 10 centimeters, they can make X percent improvement in the throughput through their factory.

And they only knew that through a digital twin. So that's what I'm, I'm excited about, you know, novice very much, but, but. I'm upskilling myself. There you go.

Richie Cotton: That's very cool. I think you might be the first person this year that's been very positive about the idea of a metaverse. But yeah, certainly Digital Twins, very, very cool technology and yeah, a lot of applications of that if you've got physical products or warehouses or whatever. Wonderful stuff.

All right Susanna?

Zuzanna: Yeah, I would be a bit more forward looking. I'm extremely excited about the potential of life AI. So we don't have it right now, right? LLMs are batch by definition. But being able to actually act and I have AI systems operating on fresh facts. And like we do, this is going to be an enormous breakthrough.

And this is something that we're at Pathway, we're extremely excited about.

Richie Cotton: All right. Real time AI. that's maybe the next episode. We'll have to come back to that, but also a very cool idea. All right. Wonderful. With that thank you so much, Susanna. Thank you so much, Elaine. Real pleasure chatting to both of you.

Zuzanna: Likewise, thank you so much for having us.

Helene: Thank you.