Building Human-Centered AI Experiences with Haris Butt, Head of Product Design at ClickUp

Adel Nehme: Hello everyone. Welcome to DataFramed. I'm Adel, Data Evangelist and Educator at Datacamp. And if you're new here, DataFramed is a weekly podcast in which we explore how individuals and organizations can succeed with data and AI. I think it's safe to say that every organization today is trying to figure out what to build with AI.

More importantly, they're trying to figure out how to embed AI into their products, systems, processes, and workflows. And of course, when looking at the ingredients that determine an organization's ability to ship successful AI products, the usual suspects emerge. Skills, a technical infrastructure, and a good understanding of the limitations and capabilities of AI systems today.

However, there is another key ingredient that is often not talked about enough in my opinion, which is great design. In a lot of ways, the success of ChatGPT is not just due to the underlying model's performance, It's also due to the fact that it's neatly wrapped up in a human centered user experience and interface which is in this case, the chat interface. So how do you build human centered AI experiences? What is the role of design in driving successful AI implementations? How can data leaders and practitioners adopt a design lens? Here to answer these questions is Horace Butt, head of product design at ClickUp.

In case you haven't seen it, ClickUp is a project management tool that's been recently making a big And Horace plays a key role in shaping how AI is embedded within the platform. Throughout the episode, we spoke about the role of design and driving human centered AI experiences, the iterative process of designing for AI, how to design AI experiences that promote trust, How designing for AI differs from traditional software engineering, whether good design will ultimately end up killing prompt engineering, and a lot more.

If you enjoyed this episode, make sure to let us know in the comments, on social, or more. And now, on to today's episode. Haris Butt, it's great to have you on the show.

Haris Butt: Thank you. Great to be here.

Adel Nehme: So you are the head of product design at ClickUp. For those who are not familiar with ClickUp, ClickUp is an excellent project management tool that we even use to manage the DataFrame podcast really for any, about any type of project or role. Most recently, you unveiled the latest iteration of ClickUp.

And as you can imagine, if you clicked on this episode, AI is a key dimension of the updates introduced. So maybe to first set the stage for our conversation, Haris, How do you view the role of AI in transforming how we manage projects?

Haris Butt: Yeah, for sure. I think, it really kind of boils down to integrating it in a way where it doesn't really feel like a burden on people. It is a technology that we're looking as a way to really bring like process and workflow automation to the masses, right? So, as we've seen it today, you've seen a lot of cool stuff around like generative images, audio, text and all that stuff.

But it's really good at summarizing data as well, But the context is the thing that really matters. And so within ClickUp specifically, You have all this context around work, whether it be a project, whether it be a document, knowledge, whatever that might be, and a big chunk of how we see it is how do we use this in a way that makes the workspace feel intelligent, not in a way that makes it feel like there's something else you have to do in order to, get the benefit of this technology, right?

And you see that today across all the offerings that a lot of our competitors and even new companies and point solutions are coming up with roughly how we see it today, where, right now it's just like an artifact that is presented to you inside of these new tools.

But as we look to it in the future, it really kind of becomes more about how you incorporate these technologies in a way where the product itself becomes more intelligent and intuitive. It helps you move faster, work smarter and all that stuff.

Adel Nehme: Yeah, I'm very excited to unpack that in a lot more detail with you. And think about how, design plays a big role in making that, technology come to life within these tools. But maybe to further demystify, how ClickUp is integrating AI into its project management tool, maybe walk us through what ClickUp AI unlocks and how AI will be driving the next iterations of ClickUp as we look to the future.

Haris Butt: So you look at chat GPT today, always refer to like programming where anyone can learn a programming language today, But for some reason it's kind of difficult to do. Talking to computers is tough. A. I. Made that a little bit different. It made talking to computers a whole lot easier.

The machine can take human like natural language instruction now and do things for you. And so when chat GPT first came out, and we started thinking about how to incorporate this into the product. We kind of looked at chat GPT. We looked at how other tools are doing it.

And the first thing we noticed was well, there's a huge barrier to entry. So what do you even say to get a desired output? What can you even use this for? And so first thing that we actually started doing was building custom tools, right? These functions inside of the product that would allow you to do specific things by providing a certain set of instructions.

that are giving you like Just a little chat box and waiting for you to figure out what exactly to ask it. We created tools for marketing, for sales, for support, product. And what that basically allowed us to do was humanized props in a little bit of a way, right? Where you go to your mom, you go, you go to any, any like common knowledge worker and you're like, Hey, yeah, come up with a prompt for yourself.

And that will basically allow for you to produce a set of inputs. And get yourself magical output that helps you move faster. But it actually created slowness in that coming up with a prompt is difficult to do. So, we built out a team and we started putting together a library of proprietary, like prompts that would.

help certain functions or roles. And so that was the impetus for our vision, our North Star for ClickUp where it's like, okay, we have to humanize AI in a way where it speaks your language, And we're continuing to push down that path. So the V1 of ClickUp AI really introduced.

templated prompts, but we did it in a way where we created like an interface that accepted a set of inputs to help you produce outputs more So really common example would be like meeting notes. So where are you having a meeting with? What are you talking about? What are the desired outcomes?

Normally you would open up a I and say, Hey, I want a meeting note template. That wants to do this, but we went ahead and did that for you by creating an interface for it. And so when you use ClickUp AI now, you just click on a button, say meeting note, say what it's for, and then we use our own prompts to generate that meeting note template for you almost instantly.

And so that was like v0. Now, as we look to it further, there's a lot of other cool things you can do too, right? You can reference things inside of the product. You can add context. Related to work projects where people so I mean, if you follow that line of thinking further, that's where we're going to land in the coming months.

as an integral kind of pillar to how clickable work and function in the future. That was kind of just a way for us to start thinking workspace.

So if you're inside of a task, Yeah. Might not make sense to offer up some of these tools in those areas, right? So a big chunk of AI, I think, falls onto context, what you might be doing, who you might be doing things with. within the scope of work and intelligently presenting that stuff to you.

And so the next evolution of that, as we continue to pull on this thread was like we started to think about, this process automation, like where is the burden? Where is the time being wasted from like majority of people? And we looked at like what A. I could reliably do given a set of it.

And the next thing we started Thinking about was kind of like, everyone's going down this path of co pilots and chat companions and things like that. We once again, following this line of like humanizing this technology in a way we started thinking about it more, through the lines of like, who is this person inside of your workspace?

And we kind of landed on an AI project manager and that instantly made it a lot easier for us to think about. What would this a I project manager do? The status updates, the stand ups, the weekly summaries, all of that stuff came into view. And then we got really excited.

Then we're like, Okay, all right, this is this is getting fun. And so you think about I'll just, like poke around at some of the ideas. But like when you think within the realm of an a I project manager, it wasn't so much like, let's replace project managers everywhere.

Not yet, at least. But we were like what if everyone had their own project manager? I say this a lot, but like, I really do believe that like modern work, workplace productivity remains unsolved in some ways. Lots of really cool tools, lots of really cool platforms.

But we still haven't really achieved a tool actually molding to the way you and your team work, which is, I think, a North star for our product org is like we have an incredibly flexible product, but we still need to make it like work how you work basically right now. The delta between Signing up for a tool and getting it, getting it to that point, it takes a lot, no matter what tool you use, it's a lot of effort, And so with the AI project manager, it became more about what are the things that we could reasonably do right now that would just help you kind of give you, give you peace of mind, get you moving faster. So we started with thread summaries, right? So we were like, Oh you're having conversations with your team.

You're doing it async. Once it gets past a couple of responses, you're just sitting there staring, poking through, trying to find the action items and whatnot. And so with thread summaries, we made it so easy to just like click a button and get high level points, right away items presented to you.

Obviously, we're following the data and the moment we roll it out, it's like, boom, right? everyone wants like the TLDR. I wanted to call it TLDR actually, but we didn't get to do that. It doesn't really have like a positive spin to it. But that was like a really cool, like, aha moment where we were like, wow, this is, it's just a button, but it really does simplify so much of your ability to keep up with work and keep things moving.

So then after that, we're like, Okay this works really well. What else can we do with the data that's unique to people and their projects inside of quick up that other people wouldn't necessarily be able to do? And I think this is where a lot of the project management management excitement came to light where, we have such a vast Amount of data inside of click out that is related to people, teams, their work and our atomic unit of work is the task, So you create a list, you start creating tasks and you got like a hundred or so of them after a couple of weeks really comes to becomes difficult to just like keep up with that, right? Like project managers are basically the ones that are staring at it. giving you a weekly update, changing statuses.

So we started, we have, we actually have like a really robust like task activity data pipeline. So then we were like, Oh, okay, cool. What if you had a time interval and now you can just follow this task instantly? And what if we made it so that we placed emphasis on the tasks that mattered to you most, So then we added task summaries. So there's a part to this that's just fine tuning the function itself. Like Adil goes to recording with Horace today, and we've got like a long brief and you, you hit it. But then you think about it through the lens of like process automation.

we have like a really powerful automations framework too. So now let's just say anything that's due this week, I want an automated summary sent to me. So if you follow this, I know I'm like putting a bunch of different things out there. But. When you look at ClickUp as like an all in one workspace, right, you're beginning to create this feedback loop now.

So we've created a function, and now we're using automation as a way to feed it into your inbox. And basically, once we get this to completeness, right, and we add all the bells and whistles, you can totally imagine a world where you sign up, you tell us how you work, what are the things you want to keep up to speed with.

And then the flywheel just gets and then you just go about doing your work and you don't really have to worry about someone keeping you up to speed. Things you're watching, things you're assigned to, things where you're mentioned all of that stuff begins to neatly be presented to you.

So we've got the function parts done so far. We're doing it on the task. We're doing it. We're doing it. At the person level, yeah. And so the next kind of few things that we do, I mean, I don't know how deep you want me to go in them, but the other things that we started to do then were at the person level, killing the stand up.

Like what an enormous waste of time. What did you do yesterday? What did you do today? What are the blockers get into a meeting? And so we started to automate that recently. We've got that coming out the door pretty soon, which is really, really cool. And then custom fields. So your lists and projects are filled with lots and lots of crazy, crazy updates.

Now, imagine you spin up a project and you set a time interval and every time you go to your project, it's just neatly updated. So that's at a high level where we're headed as a company. I don't know how much deeper you want me to go, but it really is about introducing this intelligent kind of framework into the product in a way that like just lets you be almost like driving a Tesla.

your hands still have to stay on the wheels, they still have to stay on the wheels, but the car does drive itself and it's aware of all of its surroundings. Eventually, hopefully we get to a point where the hands are completely off. But at that point, I'm questioning what the point of work even is,

Adel Nehme: so there's a lot back there and there's a couple of things that you mentioned at the beginning that I think I really want to tease out, right? You mentioned two keywords here that I want to focus on. First one is interface, right? And The second one is focusing on, you know, humanizing humanizing AI. So I'm really eager to explore the value of AI and reinventing project management, really removing the drudgery of day to day work, right?

But I really want to focus with you, given your experience with design, given the way you're thinking about the integrating AI into the ClickUp experience, is the role of design in creating the beautiful, user centric, highly human AI experiences, right? In a lot of ways, right, what made Chetchi... He's so successful.

What made it explode was that simple chat interface that really demarcatized a sophisticated large language model in the hands of the masses, right? Like even my parents asked me about chat, they've used chat. So maybe to first set the stage, how would you first define a user centric experience in the context of interacting with a large language model?

Haris Butt: you know, I spent a lot of time thinking about this, but like, really think that when it comes down to it, probably isn't. Anything better than natural language to leverage technology, right? And what's really cool about you think about A. I. Through a design lens, right?

It's like think about like how you meet a stranger almost Like A. I. And it's in and of itself is like a black box. You really only get where you're able to ask it. Same as when you meet a stranger, you're like, it's tough to come up with questions and like Well, you know, carry the conversation a little bit.

you can have a list of topics to talk about when you, when you have a, but in the

Adel Nehme: Good list of prompts.

Haris Butt: Yeah, list of prompts. Exactly. It's kind of difficult. You, you, you don't really, you don't really know what you can get out of a conversation, right? Both in a, in a person to person perspective, but also like person to technology.

You have to be really good at asking questions, right? And so if you follow that, you look at, being chat, they've incorporated it into the browser. A lot of project management tools have put like a little chat window there. I can't help but feel like most of it is going to come from designing the other side of the conversation. And what I mean by that is like right now I have to come up to you and say, Hey, I'd like a template. For something or I would like to do this when I think about that interaction, I actually want to flip it in a way where A.

I. Is asking you what you'd like to do, It's presenting options to you based on what you've done in the past within the context of things. And right now it's kind of it's scoped to your specific applications and platforms and such. But you can totally imagine a world where this is just on your machine, right?

It's on your laptop. It's totally local to your entire computer environment. And when you think about that realm of design, what do we have today? We, we've had Siri. That did great. And I just, I just accidentally activated it on my phone. We have, we have Alexa, we have Google, we have all these things, but they just listen, You're never in your house. And the home assistant's like, Hey, it's 90 degrees outside right now. You want to turn on your air conditioning, Or you left your car unlocked. Did you want me to lock it for you? Small things like that, which give you the confidence and knowledge to understand what these things are able to do for you, right?

So then your way out the door, when it's hot outside, you're set. You're, you know that it can do this. You turn it on right now. You're like, Hmm, I wonder what this thing can do. You ask a question and it's like, sorry, you have to go to do something else. And so within the realm of design specifically, I, I really think about that experience a lot where today we just add buttons to everything.

It's like AI this, AI that, and you see this across all the projects, AI comments, AI, and I think of it as, it truly is experience design in the sense that When you're somewhere inside of a product or when you're doing something it's that proactive nature of the technology that can sense what you're doing and if you, bring your attention to something that may be a value to you.

And of course, from there it comes to, customization, molding it specifically to how you work. But that's how I think about it through the lens of design is that like the natural language interaction part is probably really good thing. As you mentioned, it opened it up. It humanized it, It really did.

It felt like texting your friend, And the really great thing about it, I think, was that it created more of a feedback loop between person and computer. Whereas normally in programming, you write a function, you test that function, like, gosh, like something didn't work, something broke, and then you rack your head up thinking about how you fix this function.

But now you're just a continuous eval loop where it's just like, Hey, can you give me the weather? Where do you want the weather? Like, here's the weather based on what I know. Oh, no, I meant weather in London. Okay, cool. And you just keep on like probing at it until you get the desired output. And I get really excited by the idea of an intelligent workspace in the sense that well, I just doesn't you don't really need to talk about, want to move in a direction where The interface of an application just evolves in a way that it accepts these inputs and presents these options to you in an intuitive way to help you get things done. So you're setting up a project for the first time, You should be able to instruct AI, not in the sense that AI comes up as a chatbot and says, Hey, what would you like to do?

Kind of thing. You're kicking off a project and you can present a set of inputs and have that be generated, And then from there, a, some kind of experience that allows you to tailor it further. And the real bulk of the benefit there is from like the fine tuning, basically, right?

If you want to run marketing briefs, if you want to run your engineering team, it can sense that. I don't know how far we are from that. I'm still kind of like blurring, but I can't help but feel like most interfaces will need some kind of overhaul or evolution that kind of accommodates this because the back and forth between an application and chat, I think is less than ideal right now.

It's not integrated in a way that actually helps you be that 10 X human being,

Adel Nehme: Yeah, so there's this idea that I think we're circling around at the moment, which is, I think over since the release of Chachapiti, there's this concept of prompt engineering, right? That has been widely quite, quite publicized. A lot of people discuss is this the next big job, right? I'm of the opinion that I think design will kill prompt engineering at one point in time.

And what I mean by that,

Haris Butt: I totally agree.

Adel Nehme: And what I mean by that is like a great interface, you know, you mentioned here, like, click up, a press a button, really kind of AI actually is proactive about presenting to you what type of capabilities it is, right? Think a marketing specific task, right?

There's a slider here somewhere, right? That makes it specific to a marketing. task, right? So, where do you see that skill set of prompt engineering evolving? And do you think design, and how do you think design will kill prompt engineering in the future?

Haris Butt: Oh, man, I actually love this question a lot. I think there is definitely value in the prompt. Still, I don't know that design will kill prompt engineering, but I do think that the marriage between prompts and design are going to really unlock the next like productive interface for human beings.

Like when we first worked on the AI tools it was born out of, honestly, I was showing Chad GPT to my dad. And I was like, hey, check this out, right? So I'm like generating snippets of code. I'm generating a QA checklist for features. He's just like, what the heck is, like, what, like, what are you talking, what is doing this thing?

It's totally confusing. And I kept on thinking about that. I was like most people aren't techies when I used to work at the Apple store, right? Like people would be like, how do I set up, you're buying a 3, 000 machine and you're like, how does email work? And I always think about that through the lens of like designing products.

And so I was like I don't want to put a chat screen into ClickUp as, as a first thing for AI. I don't think it, it just like sets off a light bulb for

Adel Nehme: Yeah. It's not an aha moment.

Haris Butt: like, that was like when I first started thinking about, like, what is the interface then, And all you heard about was prompts, prompts this, prompts that.

every influencer, every person had their own prompts that they wanted to get out. How do you pick? like, which one's the right one? Which one's good and which one's bad, there's just so much to it. So I wanted to simplify that. And I was like what if it was just a simple form, So we hire a prompt engineer, we battle test them ourselves, we make a list of things that we would use AI for, and we templatize it, we kind of leave the whole prompt terminology behind, and we just build a tool. there was a lot more to it that I wanted to do that we haven't quite gotten to yet, but, When I shared that with my dad, it's a normal form, And it was like, you want to put together an SOP? There's an SOP button right there, select it. And I think when you think about how prompts are going to evolve, I think it's going to mostly be the presentation of the prompt. I don't know that the form was the right thing, right? But it's actually accepting a series of inputs, Putting it through a series of like conditions and rules. And then get getting you to and output a really cool example of that, I think there's a, what was the app called? It was there's a really cool app. I tried out this week. It's called like gamma dot app. Have you heard of it?

Adel Nehme: No, I haven't heard of it.

Haris Butt: uh, It's like a, it's like a presentation.

It's like a slide deck software. I was working on a, I was working on like a pretty long doc and I was like how do I, I was like, now I have to go turn this into a deck so I can share this with the team, and I remember that I had seen this app somewhere, but it was so awesome.

I just took this doc. It was formatted perfectly and I dumped it in and it accepted, like it asked, how, how do you want to present this? I said well, I want to keep the formatting of the document and I want to share this with my design team and I don't want it to be more than 10 slides. And it took the contents. Okay. And it just perfectly, like literally perfectly spit out the ideal slide deck. And not only did it do that, there are parts of it that kind of cover like diagrams and visuals. It went and mapped visuals to the sections and laid them out inside. I was, I was just, I was shook, I was just sitting there being like, now, imagine if we brought this kind of experience to ClickUp where You have all these knowledge bases and documents you want to present your new, vacation policy, Imagine that there is like a tool for turning something into a presentation with a click of a button.

I think there's a part to it where the, there's a base layer of prompt that achieves a specific output. But I think there's another part to it that is like it like adds to the prompt. In a way that is unique to you. So right now that's like re prompting, right?

But it it doesn't change the underlying prompt. So I could ask it to do something and then I say, Hey, no, I want to refine it further. Do this, do that. But then you go back and like all those changes that you made don't converge. They don't compile. And so I think when it comes to, you how design is going to influence that, it's really going to be Yeah.

Like how do you create that loop, right? Is it learning? Is it is the AI learning? I'm not entirely sure. Giving that feedback to you as you wanted to put together. brief to talk to me today and you're like, no, those are not the right questions. This is not the right tone of voice, Are you going to do that every single time you want to talk to someone? Or is it learning and giving you feedback asking you, Hey, do you want to modify it The question you're asking so that the next time you do this, it's easier to do. That's where I think design is really going to overtake lot of this prompt stuff.

Like it's, it's not, it obviously matters like what's underneath the hood, but I think creating the feedback loop between like man and machine is really going to be the thing that makes AI actually useful instead of like kind of helpful.

Adel Nehme: Yeah, I couldn't agree more here. And I think we can dedicate an entire episode just to discuss this particular topic, right? But you mentioned the earlier thinking around the ClickUp AI and how you're thinking about developing the interface for that intelligence layer and the ClickUp app.

Maybe Chachaputi was released late 2022, right? Walk me through that journey of iteration and that kind of the different... Ways that intelligence layer changed and click up and how you're thinking evolved up until release today.

Haris Butt: So obviously, I mean, the first part, like with these tools, it was like you get the tools in. Okay, you give it a series of inputs, produces an output. that was V zero. We added reprompting after that produces the output, modified the output. And as we kind of like observed, like the tools were helpful.

Like, obviously there's like the generative part, which is like, Hey, write me a blog post, do that. We baked it into docs and we baked it into our task creation experience. And we kind of let it sit there. We were like, okay, let's like, see where that takes people. it didn't catch like wildfire obviously enough.

And we were like, why? why is that, and that was like the light bulb for me personally, where I was just like, Even if it's there, people don't necessarily reach for it. You know what I mean? Like you're it's very tough to change behavior. And so the chat interface and us evolving that into more of like a tool slash form was cool.

I still think we have a lot of improvement to do there. But then it became more about, okay this actually has to exist. More functionally inside of the product. It can't just be like you talking to almost like a person inside the product. That's where we started moving into like, okay, this needs to obviously be baked into the product experience as a whole.

Now we could definitely blow thing, blow the entire application up and go like all right, everything's all intelligent. But obviously we can't do that. We have to like yeah. We have to be thoughtful about how to kind of weave this into the product experience where it's just like a new affordance that shows up and you're like, Hmm, what does this thing do?

And that function, that feature adds value in a way that it creates supply wheel and that conversation with AI. And so that's kind of where, as I was mentioning earlier, we started doing like Killing the stand up, getting automatic task updates, getting automatic thread summaries and things like that, where now, instead of like, Hey, do you want to write a blog post?

Or do you want meeting notes and things like that? like the tables turned a little bit where it was like, Hey, I'm offering up this information to you about the thing that you're looking at. And That's still kind of remains the goal today. We're not quite there yet. We're still in prototyping mode in the sense that there is obviously a I in the sense that everyone's using it today, which is, chatting back and forth, thoughtfully creating moments in the application.

I like stand up a lot like stand up is one of those things like We all racked our brains on for a long time where we were like, damn, every single person on every single team does the same every single time. And then you have a person employed to hunt those things down and make sure they get updated.

And then you have a manager that's responsible for like reviewing and all this stuff. a lot of time, you know, larger and larger and organization grows. And so yeah. Touching back on the idea of like an AI project manager inside of your workspace, the central theme for this is trust, our case, if you have a project manager, you need to be able to trust this project manager, right? that is the underlying crux to AI and that kind of makes it. really important to be objective about the information being presented to you.

And so based on where you are, what you're doing, having the ability to get that information and being able to trust it and then continue to probe or get more information is where the bulk of our attention went to. And we're still going down this path. As I mentioned, we want to get to a place where this is like virtually automated.

But from like a design evolution, it was like put AI everywhere because everyone's talking AI, like, let's just go crazy with it. Like AI this, AI that, and my thinking has completely gone 180 on this in the sense that like, I don't want, I almost don't want to talk about AI.

I, I don't want to say that this is AI. I I want it to feel, keep referring to that. That's like, yeah. want it to feel like driving a Tesla. I really do. And that like, like slowly over time, you sit in a normal car versus a Tesla, like all the belt, like all the knobs and all these things kind of like disappeared.

And I know a lot of people say that's not a good thing, that bad UX and all these things, but I think the intention behind it is get to a point where like, you are hands off, right? You're not thinking about these things anymore. And it's creating a new foundation for experience, And so a lot of, I think, what we did in terms of like seeing chat GPT come, right? And then they like chat GPT allowed you to create different threads. Most of the AI apps allowed you to create different threads. Next, you're probably going to see people wanting to organize them or save them or share them.

Like all these things naturally kind of emerge. it's the same for ClickUp, It's like, all these new AI needs are going to. Emerge. And there's two ways you can look about, look at it. And I'm sure every single, every single company is probably thinking about this in a way that well, there's, there's one world where there's a parallel AI experience inside the product.

And there is a separate world, which is is just perfect. AI is the product. just the next version of the product. And things will slowly begin to like be simplified, organized in a way where it's designed to take an input and produce the output for you. It's designed to learn what your next step is.

So before you can even think about it, it's presented to you. I don't think we're quite there yet. I think we have quite a bit of work to do. I think a large chunk that kind of boils down to us, like. What parts of what we've designed so far are we going to have to undo to accommodate this? And that's the design challenge today.

Adel Nehme: Yeah, and there's one thing that you mentioned here as well throughout your your answer was that was very resonant was just trust, right? Like, how are you going to trust to say I project manager, and I think there's a big risk, of course, this is quite widely discussed, right? Like the risk of hallucinations of bias of, fabricated output from a particular model, when you are, let's say you're in the ClickUp app, and you get a summary of, a thread or a stand up note or like with all of the action items, right?

What is the role of design in maintaining trust and ensuring, and minimizing these potential risks of a hallucinated action item or even, even worse, like a forgotten action item that didn't make the cut in the summary, for example?

Haris Butt: Yeah, for sure. There's actually a really good example for this. So, we actually have one of the only universal search products in the productivity space. And so we were like okay, we have access to all this data. We can do this. Ask AI experience, right? So you open up the spotlight and you're like, Hey, what is our office PTO policy?

And so the V zero of it was just like and this is this was even for summarizing docs and things like that. We're like, Oh, if we have this knowledge based product, you can just ask your workspace anything. And based on the data we have, we're going to give you an answer. And you load everything up into the vector db and you index it all and you're, you're good to go.

And the V zero of it, I think, I think I actually asked like, what is our vacation policy? And it gave the most bizarre answer. Like it was ridiculous. It was ridiculous because People use docs for all kinds of, like, every team is using, like, it's not scoped to me, it's not scoped to the workspace. There's all kinds of random things inside.

And so I, I asked something, I, I swear, I think it was like some kind of quote from Star Trek or something like that, that part. And I was like, okay, so, this is not helpful. So from there, it was kind of like, how do we build an interface that doesn't make you freak out?

Like, is this completely artificial? Does this exist in a doc somewhere? So really simple example of that was like, we just like incorporated sources. And building out the functionality to specify sources. So you know that the experience is contained to a set, like a defined set of knowledge or information.

And I think for ClickUp, it's a lot easier because we'll definitely move down this path. Where the information is scoped and relevant to you. we'll build out the stack in a way where if like Horace. Has a meeting notes doc, and he says, this is this is a doc that is I want in my click up brain.

And there is our design team handbook, and this should be in the click of brain. And there's like our product development framework. So like I will move in the direction where you specify the knowledge, right? So you know, the knowledge exists, it has value to you. And when you ask for information as you need it, yeah.

It's presented to you in a way where it says, here is the information and here's where it's coming from. So, you know, it's sources, it's citations and things like that. And I think if, if you're familiar with like, perplexity They've done a really good job at this. And I think I took a lot of inspiration from that. And, you have barred and you have chat G B T, but perplexity, I think took it one step further. In that I don't know that they were focusing on trust, but it makes me trust it More because that context is there for me and I think about it in a very similar sense in that that's just knowledge, but you also within a collaborative workspace want to know who said what, So if I summarize a project, it's not like, Hey, this is what's going on, right? Then wait a second, like who made that decision and what, like, why is this being said, That whole like citation and context. we still need to add that in and there are still times when I'm like, do a task summary, I'll do a project summary inside of ClickUp and I'm like, oh, sweet.

But then there are still those moments where I'm just like I know this isn't a hallucination, but I don't know exactly where this is coming from. then it's not useful anymore, right? Because then I have to go right back in, I have to comb through like a dozen or so comments and like, like, oh, okay.

There is my peace of mind. It's not just like fabricated. It's actually just not included. would say that's like probably as far as I've thought about trust so far. I'm sure there are other things Around like letting you know this certain information is secure, Like I don't know, maybe you had to submit some kind of form where it's asking for your social security number and your, private phone number, You can just submit it and then it does something with it. I would personally appreciate some kind of like, hey, This information isn't being stored anywhere. It's not being shared one. There's a lot of that. I think that still needs to be incorporated on a larger scale, right? Like so much proprietary information that companies have that prevents them from using AI technologies and such simply because of the fact that you're training these models on sensitive data.

And so We have to build that trust, letting people know that their, their, their workspace data is safe with ClickUp, we have to create that feedback loop in some way. And I think just starting with the sources is probably a good place.

Adel Nehme: So, in a lot of ways, what you're mentioning here around, you know, hallucination and, the risk of hallucination is very unique to large language models, And to that particular type of AI. you know, I think traditionally design teams and engineering teams that I have to grapple with these types of issues where it you know, the set of interactions exists in an infinite space where you don't necessarily know.

What is the output a large language model can have, whereas traditional software, right, exists in a finite space. One plus one equals two, right? You know for certain what is the output you get given a certain type of input. So maybe given that, walk us through the unique challenges of designing for large, large language models in AI, Unlike traditional software or traditional design in this, particular circumstance. Yeah,

Haris Butt: For sure. I think, it really just boils down to context. Like, just to think about it in the most simple of terms. I just think about it in terms of context, there's like billions of permutations and parameters, maybe trillions, I don't actually know. As you mentioned, it's, it's a black box in the sense that like, the output is near infinite at this point, right?

Where it's just like, you put something in, something's gonna come out. Some point, that's just how it works. And so I think the difficult thing is, like, thinking about using AI within a certain context and making that like, intuitive, meaning that like, if you're interfacing with a doc, you're interfacing with a task, a person, a project, the whole workspace as a whole.

The interfaces we have today don't really make that obvious, it's just a blob of text that gets presented to you. Sometimes it's structured, sometimes it has citations. It's not obvious to people what part of the black box you're talking to, right?

It's not obvious like how this kind of information comes together inside the product. In a way that helps you trust it. So I'm personally not probably qualified from a technical sense to speak on it. But I think just from a product experience perspective, the it does come down to trust and context to me in the sense that has to feel like second nature to you.

In the sense that when you are interfaced, like I use Siri as a good example for this, like you just don't know what you're going to get out of it, right? one day it might answer your question, the other day it might tell you to open up your phone and go to the browser and do it, do it yourself.

With large language models specifically, I think specifying the information within the context of what you're trying to do is, is a challenging things to thing to do, because I think just as easily as you can have information presented to you, it can just as quickly become a daunting task to go figure out how and why this particular output was produced for you.

Right. And I think going back to the prompt engineering bit, this is where it gets really fussy because You have chat GPT 3. 5. You have anthropic clod. You have what is it? Chat GPT what is it? 4. 0 or whatever. Like these models continue evolving, and there's no, there's, like, when we first did our AI tools, we built it on top of 3.

5, And that, that accepted a specific set of instructions in a certain kind of way that were optimized for what we were asking it, right? And then it was like, oh, okay, let's switch it to 4. 0. tons more parameters, tons more creativity. It'll like, it unlocks a whole lot more.

Might be a little bit slower, but it'll be more powerful. But what we actually found was the model doesn't work the same. I don't know why, but it doesn't work the same way. And now you got to go back and like all 200 tools that we wrote. Now you got to, you got to create that feedback loop again. You don't know the diff.

And you think about that further. This is just. you know, we're, we're at the bottom

Adel Nehme: very beginning.

Haris Butt: Yeah, this hasn't started yet, right? Imagine when like multimedia and all these things begin to be incorporated into the models. Prompt engineering is going to be like Amazon Turk.

Like you're just going to need to keep going and going and going until you get, like keeping up with this is going to be crazy. And so my mind wanders in that area where it's like, are we going to build our own model? Like is building a model going to like it's very costly right now.

the hardware required to produce it or create it is costly. I don't, I don't know what the answer is there yet. I think this is just, this is just going to be the nature of the game for a little bit where the space is going to evolve so fast. And I think this is where design becomes really powerful actually, where if we let the evolution of the models be what it needs to be, we focus on fine tuning the experience.

So regardless of what the information is that's gonna be passed through. We just think about exactly what the interaction between you and the model is going to look and feel like how we're going to bake it into the product experience. So even if you change what's underneath the hood, maybe the outputs we can continue to fine tune, but focus on the experience so that at least the data is available to you.

The information, the usefulness is available to you as you need it. And then let the large language model wave go and see like what it allows us to do.

Adel Nehme: That's pretty great. And in a lot of ways, we're currently in the wild west of AI when it comes to kind of,

Haris Butt: hundred percent.

Adel Nehme: the uh, the, the ecosystem and how it's evolving. And as this wild west, that we're discussing evolves, right? I'd be remiss not to talk to you about where you see the future of productivity heading, right?

Fuming models get stronger, better, more resilient, Where do you think workspace productivity will be in a few years?

Haris Butt: Oh, geez. I wish I had the answer to this one. It's really tough to say, to be honest. There's a part like, obviously, there's like the doomsday approach, which is like, productivity is no more like you don't need to go a farm or pick up a hobby or something like that. But I, kind of see productivity.

Across the timelines as like a series of like expansion and contraction, right? Like there was a point where we were punching in punch cards to talk to computers, right? To just run a sum function, Knowledge breakers were writing on like sheets of paper and that was compiled into notebooks and presented on someone's desk.

I feel like it's just going to allow people to do it's just going to unlock a new generation. It's going to just redefine productivity. I don't know what that looks like yet, but I can talk through my own experience in that like I run both product and design, And it's like left brain right brain a little bit.

It's takes a lot of it. It's a lot of my time right outside of like Yeah, Hiring an assistant or bringing on an additional project manager or, moving waste more slowly. there aren't really any tools that make my day to day really easy, It's just a lot of mundane repetition process.

I'm very, like, I'm working on the tools that are going to take that all off my plate, right? And then I think about what is that going to allow me to do? And going to unleash my creativity. It's going to give me my brain back. Like, it helps me be strategic. It helps me be creative. It helps me start thinking ahead more.

And, there isn't really an outcome tied to that. But you can see that if I get my time back, which is ultimately our North Star, right? Like, we're all about saving people, teams, companies time. When we actually achieve giving like actual time back. You can imagine people are going to start spending it in other areas, they'll have new tools where these kinds of things are more generative, now instead of hey, I need to spend a whole day writing a project plan. It's written for me I get to focus on how I'm gonna communicate this, And now there's a tool that communicates it for me too, right?

Like it produces that and it's like You just start moving faster, right? You see this like across the evolution of like agriculture. You had humans picking every single you had humans picking every single fruit and vegetable. Now you have robots roaming or roaming across like crops, just picking things off.

This is ultimately what industrialization does, what automation does. And so, yeah, I think a lot of mundane jobs and such will be eliminated. But at the same time, I think it's just going, you're going to have this new set of tools that you can weave together in a way to, to do incredible things.

And hard to say what that looks like right now, right, you see glimpses of it with like, I don't know if you've seen like runway ml, where you can like, you completely generative videos, there's и there's like Dolly and Stable Diffusion where like artistry is, there's just like a new class of artistry evolving.

You see people making music with other artists voices and merging you said it perfectly, it really is the Wild Wild West in some ways. I liked it. I I mean, there's a, he passed away recently, but like, I think it was like Virgil Abloh or something like that, that said like every, like a remix of something else.

I think we have like the most powerful remixing tool ever, right? Like just like literally God mode remixing what you want to mix a photo. It's like, like remix it, you know, and cool because you just have like the easy button like try again, try again, try again. And hard to say where that takes you, right?

Like, is all of our music just going to be completely generated at some point is all art. Yeah, it's, it's, it's crazy to think about, but I think within the realm of productivity specifically. I think it's just going to be redefined in the sense that, like, it's obvious that these things are going to mold to you and how you work.

And I think work is going to get a whole lot more unique. I think it's going to get a whole lot more efficient. I think it's going to get a whole lot more like, what's the right way to put it? Like, tailored to you, I worked at a company called detour back in the day and they, they actually build descript now.

I don't know if you're familiar with it,

Adel Nehme: We use it on the podcast.

Haris Butt: Oh, you do. Okay, cool. Yeah. So descript was originally like an editor we used to build detours. But it's, it's so funny to see, I left the company before I became descript, but it's so cool to see when we were solving that problem of editing audio tours with texts.

Is. Plus it was like a very like clunky tool, but how with AI now it like records your voice, right? And it's like a full DAW and you're just editing your voice with text and as crazy as that sounds, right? Like never would I have thought that that's how your job gets easier, Like it has transformed your ability to edit scripts put things together and just shoot it out Whereas otherwise you're in like logic Taking snippets of audio, shuffling it around.

It's truly magical. So I can't even imagine what that's going to do for an AI project manager or for AI standups, right? Click of a button. You have this information to automatic prioritization. It's like, I think at a high level, the most important things and most relevant things to you are always going to be front and center.

Right now, there's still a lot of ping ponging back and forth between apps and projects and people and things like that. But when you, when you have this ability to take very, very large chunks of data and scope it to exactly what you need it to be at any given point in time, I think it just like unlocks so much.

Adel Nehme: Yeah. And I would underestimate as well when it comes to the realm of productivity, really the potential upside when it comes to, our well being at work when you take away a lot of the drudgery

Haris Butt: Oh, yeah, for sure.

Adel Nehme: of our time, right? Like, I don't

Haris Butt: Absolutely. You go on vacation and you're, you, what is it? The Sunday Scaries or something like

Adel Nehme: Yeah,

Haris Butt: You're sitting there being like, Oh my God, I just took a week off for

Adel Nehme: And I have a mountain of work coming back

Haris Butt: mountain of work, like how, how, that's actually a really good point. I forgot about that one. But yeah, we were actually just thinking about that the other day.

But like, inbox, your notifications like fill up a lot really quickly. But like, about a vacation mode where it's like, what if you just press a button and it's like, Hey, actually, these are the only things that matter right now. Forget about the rep,

Adel Nehme: Exactly. Yeah.

Haris Butt: but yeah, that's a, that's a great example.

I

Adel Nehme: So, Haris, as we close out our conversation, do you have any final call to action before we wrap up today's episode? I'd love to hear your final on the role of design in shaping the future of AI.

Haris Butt: don't know if I have any final comments. I , I have a lot of threads to pull on, but I, my, my mind like literally wanders. It truly is, I think it's such a unique opportunity for designers out there to, to humanize the problems we see every day in a way that's like, is like completely abstract and uncoupled from an actual interface.

I think this is like one of the first times I've ever felt this way. In that, you have a set of problems and you try and cobble up some kind of interface or product experience based on some components and a design library. But this is the first time I think you can cut all of that out as a designer and think about the experience as a whole and like an end to end sequence of Interaction that doesn't really require an interface.

You can add you can add an interface if you want. You can get really clever and novel in some kinds of way. You really have to think about the individual. You really have to think about the context. You really have to think about the audience. And just think we've barely scratched the surface here.

We're still stuck in this land of like chat and buttons and all this other crap. But I think for designers specifically, I think it's just such powerful opportunity to just Start everything anew. I've been doing this for almost like 15 years at this point. I can't think of a single time I've felt this way before.

And that in and of itself is enough to say that this is like an incredibly unique point in time where we just have a new foundation to build on. It's quite possible. It's like totally okay to say that maybe There's a point where there is no application anymore, I think about that all the time.

All the time. I'm just like, it's possible that I just hit the delete button on our code base. And you just said, we just have a model, and you tell that model what work is for you, what you need to do. And this day, like you, you just. Have a thing, but it's just like an abstract thing in my mind at the moment where it's like, or like born identity kind of thing.

that's what I would have to say is that like, I think for designers specifically, it's, if you're not thinking about it in this way, I think you're, you're selling it short.

Adel Nehme: Yeah, in a lot of ways, like apparel is the introduction of a new medium in media, right? Uh, you know, Printing press came along, changed foundationally how information is disseminated. Video came along, changed foundationally how information is, in a lot of ways now, AI is changing foundationally how, information is being processed and how you interact with a computer.

Haris, it was great having you on the show, really appreciate your insight.

Haris Butt: Thank you. Appreciate it.