Leijie Wang 6:00 Hello, hello. Speaker B 6:01 That's a test. 6:04 Test, test, test, test, test. Speaker C 8:21 All righty. 8:32 But today I would like to glad to present our work about BlueSky custom feeds and titled understand the landscape of custom feeds on bluesky. Leijie Wang 8:46 I'll start with thinking about the platforms you use every day like YouTube, TikTok, Instagram or Spotify. Speaker B 8:51 Each of them has a recommendation feed that feels quite personal to you, but you have no say in how that particular algorithm works or what even optimized for like whether you optimize for likes or dislikes, Can folks out there hear? Speaker D 8:58 Can you hear it enough to, you know? 9:00 Yeah, it'll work. Leijie Wang 9:01 Perfect. 9:02 Okay, okay, sorry about that. 9:04 No worries. 9:05 Yeah, so should I start? Speaker D 9:07 Yeah, let's kick this off. Leijie Wang 9:09 Okay, um, so hello everyone, um, I'm Lei Jie Wang, um, I'm a PhD student from University of Washington. Speaker B 9:15 Like, even though I'm at Seattle, very close to Vancouver, but because of the visa issues I cannot come in person, so that's why I'm over the Zoom. Leijie Wang 9:23 But today I would like to— Speaker B 9:24 glad to present our work about Bluesky custom feeds and the title, Understand the Landscape of Custom Feeds on Bluesky. 9:33 I'll start with thinking about the platforms you use every day like YouTube, TikTok, Instagram, or Spotify. 9:40 Each of them has a recommendation feed that feels quite personal to you, but you have no say in how that particular algorithm works or what even optimized for, like whether it optimized for likes or dislikes. 9:51 The ranking is just instead decided by those single centralized algorithms controlled by those big companies. Leijie Wang 9:58 And this concentration of power in these days has two consequences. Speaker B 10:02 So first, you have no visibility into why certain content appear into their feed. 10:07 The algorithm is just a black box, and we see a lot of complaints about them in these days. 10:13 And then second, creators often learn to optimize for that particular algorithm to appease them. Leijie Wang 10:19 And over time, we can see the content start to become homogeneous. 10:23 Everywhere. Speaker B 10:23 Like, there are all kinds of clickbait kind of content. Leijie Wang 10:27 And this is what Bluesky does something different here. Speaker B 10:29 Like, they call algorithmic choice. 10:31 Bluesky custom feeds allow users to create, subscribe, and share their feed algorithms instead of being stuck without a particular default. 10:40 And on the consumer side, the feed consumers, they can further subscribe into the feeds offered by their communities. 10:47 And on the creator side, third-party tools make it possible for anyone to build and publish their own feeds. 10:56 This connects to a very longstanding vision in the research community, the idea of middleware. Leijie Wang 11:02 The core idea is simple. Speaker B 11:03 What if the social media services like recommendation, moderation, or the governance in the communities did not have to be controlled by the platforms? 11:13 What if they could be provided by these independent middleware services so that you don't have the choice among them. Leijie Wang 11:21 This is just a theoretical vision, it's already happening at scale. Speaker B 11:26 Today, as people already know in the room, like the Bluesky today has 42 million active users and over 40,000 custom feeds have been created. 11:36 So this makes custom feeds as the first large-scale instantiation of the middleware vision for feed recommendation specifically. Leijie Wang 11:45 But for this particular ecosystem to work, someone has to actually be building their feeds, and that's the feed creators we focus on in this particular work. Speaker B 11:54 But we know little about them, like what motivates them to create a feed in the first place, and what does it actually take to run a particular custom feed, and what challenges and opportunities do they face. 12:06 These are the questions driving our work. Leijie Wang 12:10 So in particular, we organize our work around these three research questions. Speaker B 12:14 First, what kinds of custom feeds are there? 12:18 Second, what kinds of— how do the feed creators building, maintaining, and sustaining their custom feeds ecosystem? Leijie Wang 12:26 And third, what kinds of challenges and opportunities exist for the custom feed ecosystem? Speaker B 12:34 To answer these research questions, we conducted semi-structured interviews with 24 feed creators on Bluesky. 12:41 And this particular chart shows the range of feeds they created measured by the likes they received on BlueSky. 12:47 Some creators, they are relatively small with under like 100 likes, but there are others who building feeds over 10,000 likes. 12:55 So we have a good spread in our interviews from the hobbyist builders to some of the most popular feeds on the platform. 13:03 And here we talk about our findings. Leijie Wang 13:07 Our first key finding is that we identify there are two kinds of feed orientations that the custom feeds can fall into. 13:14 The first is a utility-providing feed. Speaker B 13:17 They are focused on delivering the content to feed consumers, thinking of them as a well-curated feeder filter. 13:25 And there's also community-building feeds that are very different. 13:28 They're cultivating the space for the feed consumers to connect with each other. 13:33 And as we will see, these two orientations shape their motivations, their daily tasks, and how they sustain their feeds in the long term. 13:43 Specifically for the utility-providing feeds, the feed is primarily a content delivery mechanism for the feed consumers. 13:50 The creator's job is mostly done at setup. 13:53 They configure the hashtags, keywords, or vetted accounts and just let the feed run on the blue sky. Leijie Wang 14:00 On the other hand, the feed consumers, they are purely receptive or passive. Speaker B 14:05 They just follow the feed like they're following a particular channel or follow a particular blog site. 14:10 They do not actively contribute to what particular content appears in the feed by themselves. Leijie Wang 14:19 And within the utility feed, we also see two distinct subtypes. Speaker B 14:23 The first is what we call set it and forget it mode. 14:26 People just catch the relevant post of a given topic just with a very simple list of keywords such as mushrooms or some fan communities. 14:34 The creator just sets it up once and just largely forgot it and step away. 14:41 The second type is very highly curated feeds. 14:43 Those use vetted poster list or custom ranking algorithms to ensure the content, content they delivered are super high quality. 14:51 It's almost like an editor's choice or editor's pick in the newspapers. 14:56 Unlike the first type, they require very ongoing maintenance. 14:59 The creator is constantly tuning and updating their algorithms to ensure that content is always high quality. 15:08 Community building feeds work very differently from these utility feeds. 15:12 Here, the feed consumers are not just passive recipients. 15:15 They actively contribute in the content and interact with each other simply by the feed. 15:21 Like they were adding a particular keyword to their post so that they're essentially having conversations with each other in the feed. Leijie Wang 15:28 The feed becomes a very shared social place, and the feed creator's role shifts here too. Speaker B 15:34 Instead of configuring rules, they tend to the social space, maintaining norms and keeping the community healthy. Leijie Wang 15:43 I will give you two concrete examples of community-building feeds. Speaker B 15:46 So there's a particular feed we found out in our interviews They just surface the posts from the users below a particular threshold of follower numbers so that they can design it to welcome the newcomers and give the less known voices a chance to be seen in their feed. Leijie Wang 16:02 And another, just like the feed consumers curating the content by themselves, so they can just reply to any post on Bluesky with a particular keyword. Speaker B 16:10 And in this way, they are nominating the post to appear in the feed automatically. Leijie Wang 16:16 And one of our participants captured the creator's role very well. Speaker B 16:19 They said, "I almost see myself as a librarian. 16:23 I'm making sure people are not yelling, they are not picking up their trash, and putting books back when they are supposed to be. 16:29 I'm making the place as presentable and welcoming as possible." So they're just tending to that particular social space as the feed creator, which is very different from the utility feed creators. 16:43 And after that, let's take a look at about how people building their custom feeds. Leijie Wang 16:47 And we found out that most feed creators navigate the ecosystem of third-party tools. Speaker B 16:52 They do not have to start from scratch, but for some of them, those tools are not enough for their needs, so they end up building their own infrastructures. 17:01 So for example, most feed creators, they rely on third-party tools, and there's a real diversity of options for them. 17:08 Brown Sky Feed, Blue Sky Feed Creators, and Grays, just to name a few. Leijie Wang 17:13 So the variety matters. Speaker B 17:15 It means that the creators can always choose the tool that best fits their needs and their technical levels. 17:23 Within these tools, creators try to combine various kinds of building blocks to shape what appears in the feed, some using those keywords or regular expression matching to catch a post on a specific topic, Others try to maintain a vetted accounts list, handpicking who got included in their feed. 17:42 And some also use a blue sky label system to help filter the content as part of their content moderation efforts. Leijie Wang 17:51 But the third party do not work for everyone. Speaker B 17:53 Some creators have the needs that go beyond what existing tools can support, and they end up building their own infrastructures. 18:01 So for instance, one participant built a fully personalized recommendation system on their own because they needed fine-grained interaction data that these third-party tools simply cannot access. 18:14 And another tried to roll a custom implementation in Rust because their field logic is often too complex for any block-based tools offered by these third-party tools, and they also need to support much larger scale of use. 18:28 So in this way, these feed creators, they're not casual hobbyists who just try it for fun. 18:32 They're essentially running some independent technical infrastructure through the custom feeds. 18:39 And our third key finding is about what it takes to maintain a custom feed over time. 18:46 And it turned out the maintenance goes well beyond just keeping the algorithm running. 18:51 Creators are handling moderation, driving discovery, and try to listen into the consumer feedback. 18:57 And for most of these tasks, they got very little support from the Bluesky platform. Leijie Wang 19:04 So for instance, the utility-providing feed, the moderation effort is very different across these different kinds of feeds. 19:13 But for the utility-providing feeds, it's more about larger upfront effort. Speaker B 19:18 They set up them strict rules to deliver the content. 19:21 Which means that usually there isn't much toxic content to moderate for after the feed goes live. 19:27 But for the community feed, it's often ongoing because the community itself is always evolving. 19:32 There's new members joining, there's new dynamics emerging, and norms need to be actively maintained. Leijie Wang 19:39 And on top of that, the moderation decisions are also much more nuanced. Speaker B 19:42 It's not just about the topic being misaligned with your feed topic. 19:46 But instead it's a social decision. Leijie Wang 19:48 They need to carefully make sure their decision do not hurt the community relationship. Speaker B 19:55 And the Blue Sky also decentralize the creation of the feed, but they do not decentralize the discovery of the feed. Leijie Wang 20:02 The feed tab on the Blue Sky is often static, ranked by the popularities, surfing the same set of feed that were popular 2 years ago. Speaker B 20:11 And for the new feeds, especially non-English one, they have little chance to be seen by the newcomers. Leijie Wang 20:17 And the creators need to take matters into their own time. Speaker B 20:20 They have to promote the feeds by themselves on the social media in the communities whenever they can. Leijie Wang 20:27 And we heard these frustrations directly from the creators. Speaker B 20:31 One participant told us, I have been commenting on every single feed topic post I found, telling them about the feeds and how to set up their BlueSky accounts. 20:40 And they've sent out thousands of messages. 20:44 And they concluded that even though the feed is successful, but obviously it's not a sustainable strategy for a lot of feed creators. Leijie Wang 20:53 And another participant complained that if creating a new account and go to the feed tab, you will see the same top feed from 2 years ago. Speaker B 21:01 They are all in English and often only about the United States. 21:04 So it's not interesting for the people outside of the United States. Leijie Wang 21:10 And the centralized algorithms can improve the continuous on this YouTube or TikTok platforms. Speaker B 21:16 They listening to your clicks, your skips, and the dwell times and feedback into their recommendation algorithms. 21:22 But in the blue sky for the custom feeds, they have not that kind of infrastructure. Leijie Wang 21:27 There are two several kinds of feedback they can tap into. Speaker B 21:31 Like they get some implicit feedbacks from the people who likes, replies, or reposts. 21:36 Their feeds from their custom feeds. 21:38 But they lack the technical tools to actually analyze and learn from this data at scale. Leijie Wang 21:45 They also got a lot of some sort of explicit feedback from their direct messages or some survey responses they distributed in their feed. 21:53 But it's often very rare and only come from the people who are most motivated to consume their feed content. 22:00 There are also some third-party tools provide some basic analytics. Speaker B 22:04 Things like the daily active users or the post volumes. 22:08 But this only tells the feed creators that the feed is still alive, but not whether it's actually working or not. 22:14 The result is that the feed creators do not get a lot of feedback to continuously improving their feed, and in the long term, they just lose the motivation to do that. Leijie Wang 22:26 And our fourth and final key finding is about sustaining the custom feeds The custom feed ecosystem, over 40,000 feeds, run almost entirely on volunteer labels. Speaker B 22:37 Creators need to absorb the cost of running a feed themselves with very little to no platform support. Leijie Wang 22:43 And what sustains them isn't the financial incentives or the platform recognitions. Speaker B 22:48 It's often just intrinsic motivation. Leijie Wang 22:53 And if we take a step back, there's some cost of sustaining a feed. Speaker B 22:58 And on the infrastructure side, the creators need to pay out of pocket for third-party tool subscriptions to keep their feed running. Leijie Wang 23:05 And beyond the money, there's also time commitment. Speaker B 23:08 They have to do the regular maintenance, moderation, and responding to user feedback. Leijie Wang 23:14 But what keeps the creator going, we call it the hobbyist model. Speaker B 23:17 The motivation is the owning view. Leijie Wang 23:20 For the utility-providing creators, seeing their subscriber account grow is a key signal. Speaker B 23:26 It tells them the feed is still useful and worth maintaining. 23:30 But that also saying that without that particular signal, feed creators are more likely to lose motivations. Leijie Wang 23:36 And that's why we have the— Speaker B 23:37 there's a bunch of set and forgotten feeds for the utility part. Leijie Wang 23:43 For the community-building creators, the motivation comes from something very different. Speaker B 23:47 They are seeing that people actually connecting with each other through their feed, and that makes them happy about their job. 23:53 But this mirrors what we see in those volunteer ecosystems like Reddit and Discord, where the community itself is just the reward. 24:02 We also asked about feed creators about monetization, and most felt that not all the feeds can justify it. Leijie Wang 24:09 The key factor is that whether the feed is built on dedicated, irreplaceable effort. Speaker B 24:15 So for example, the set-and-forget feeds, they are very easy to replicate. 24:19 If someone charges for it, users can just build the feeds by themselves elsewhere. Leijie Wang 24:26 But for highly curated feeds, they are very different. Speaker B 24:28 The creators have the ongoing effort and judgment to make the feed valuable to their feed consumers. 24:34 And we do see some successful examples of monetization in that space in our interviews. 24:42 Creators volunteer their efforts very willingly, but they also think the infrastructure cost deserves some financial support. 24:49 One participant put it very simply that it's not about getting rich, it's just about covering expenses so I'm not going to pay out of pocket to help the community. 25:01 And another friend, even more positive, like they charging a small amount of dollars isn't just fair to the creators, it's creating a positive loop of dollars going through the communities so that the whole Blue Sky custom feeds can go. 25:15 Go more alive. 25:18 So with all these findings, we have these two design implications to see how we can further improve the BlueSky custom feeds as a community and also as researchers. 25:28 We see there's two key directions to better support feed creators beyond the initial building process. 25:34 First, we need to help creators to better make sense of the implicit feedback they get from their feed creators. 25:41 Feed consumers, like likes, reposts, and replies exist, but creators need to better choose to better turn into that noisy data into some actionable insights they can use to improve their feeds. Leijie Wang 25:54 Second, we also need to rethink about the feed discovery. Speaker B 25:57 Right now, it's still platform-controlled, even though it's very fair controlled, like it's always ranked by the popularities, but enabling more personalized feed discovery Beyond just the flat platform controller ranking, we'll give new users and non-English feeds a real chance to reach to the right users. Leijie Wang 26:17 And we also want to say something about the sustainability. Speaker B 26:21 If creators burn out and cannot cover their costs, feeds just will stop being maintained and the communities building around them will slowly go away. 26:31 From our interviews, we've found two potential pauses that the feed creator themselves are already experienced with. 26:38 One is that donations. 26:40 They will solicit some donations from their feed consumers. 26:43 This is similar to how Wikipedia sustains itself through those volunteer-like community donations. 26:50 And we also see those popular feeds doing transparent advertising. 26:54 They have some ads within their feeds, but the ads is opt-in and community-scope ads so that they can keep their revenue but do not deliver like very irrelevant ads to their consumers. 27:06 Although neither of them is a perfect solution, but they both point out towards a model where the community of the custom feeds can support the infrastructure and support itself in the long term. 27:18 Here's all of our presentations, and thank you for everyone listening, even though it's over Zoom. 27:24 And do you have any questions? 27:26 And here's my contact. Speaker C 27:34 Do we have any questions, comments, thoughts? 27:39 Nope. 27:41 Oh, what you got? Speaker D 27:43 If you were managing BlueSky, the app, what would you do? Speaker C 27:47 The question was, if you were managing BlueSky, the app, what would you do? Speaker B 27:52 I think, as what I can see in the design implications, I would at least try to improve the field discovery feature. 27:59 I think people do want that part to be Like, it's inevitable going to be some sort of centralized in the platform by the Blue Sky platform to design how to ranking these different kinds of feeds. 28:10 But obviously, I think one single feature you can see just to recommend relevant feeds for people to explore so that they are not being stuck in those popularity ranking feeds, which is always just the same set of feeds all over the years. 28:22 And I think another important part people constantly want is about better guidance about how to do the advertisement in their feeds. Leijie Wang 28:29 Like, people are kind of trying to figuring out by themselves and try to testing that in their own population, the consumers' populations. Speaker B 28:38 But it would be beneficial for them to see like what kinds of ads are tolerable in the feeds so that they can be more actionable and more comfortable like place ads in their feeds so that they're not going to do free label for the whole ecosystem. Speaker C 28:56 Great. 28:57 Well, I think that's it. 28:58 Thank you very much. Leijie Wang 29:00 Yeah, thank you everyone. Speaker B 29:01 Cheers. 29:04 I'll just leave the tube soon, right?