1 00:00:00,000 --> 00:00:01,560 How are we feeling today? 2 00:00:01,560 --> 00:00:05,360 It better not be emotions for the ocean about rich people. 3 00:00:05,360 --> 00:00:09,920 Oh, rich emotions, but spelt the other way as a pun. 4 00:00:09,920 --> 00:00:11,880 With ocean in it. 5 00:00:11,880 --> 00:00:12,720 Yeah. 6 00:00:12,720 --> 00:00:14,320 Oh my God. 7 00:00:14,320 --> 00:00:16,000 I gotta make a note of this before we both. 8 00:00:16,000 --> 00:00:17,760 Rich people's emotions. 9 00:00:17,760 --> 00:00:18,960 Oh, that's nice. 10 00:00:18,960 --> 00:00:21,600 That looks like a really wrong word though. 11 00:00:22,600 --> 00:00:23,840 I'm sure Google agrees. 12 00:00:23,840 --> 00:00:24,680 You know what? 13 00:00:24,680 --> 00:00:26,200 How is the uncertain one looking? 14 00:00:26,200 --> 00:00:28,000 I don't know the last time I updated this, 15 00:00:28,000 --> 00:00:29,880 to be honest, because we're so full. 16 00:00:29,880 --> 00:00:30,720 The brim. 17 00:00:30,720 --> 00:00:31,560 Okay. 18 00:00:31,560 --> 00:00:32,520 Oh yeah, here we go. 19 00:00:32,520 --> 00:00:33,360 Here we go. 20 00:00:33,360 --> 00:00:34,200 I got you covered. 21 00:00:34,200 --> 00:00:35,040 Don't worry. 22 00:00:35,040 --> 00:00:37,240 You're sounding very certain for a category that is uncertain. 23 00:00:37,240 --> 00:00:40,160 Oh, I'm feeling very certain for the uncertain. 24 00:00:40,160 --> 00:00:42,640 I've been holding on to this one for a while, 25 00:00:42,640 --> 00:00:45,280 so it's probably grossly outdated. 26 00:00:45,280 --> 00:00:47,400 But this is an article from Wired. 27 00:00:47,400 --> 00:00:49,320 I'm so excited about this right now. 28 00:00:49,320 --> 00:00:52,760 May 20th, 2024, six o'clock a.m. 29 00:00:52,760 --> 00:00:55,080 We're a little behind, but not that behind. 30 00:00:55,080 --> 00:00:56,520 You probably haven't heard of this 31 00:00:56,520 --> 00:00:58,040 because it's not our part of the world. 32 00:00:58,040 --> 00:01:01,440 And it's titled, Indian voters are being bombarded 33 00:01:01,440 --> 00:01:03,280 with millions of deep fakes. 34 00:01:03,280 --> 00:01:05,360 Political candidates approve. 35 00:01:05,360 --> 00:01:07,880 And then it said, no, I'm just gonna go right to the article. 36 00:01:07,880 --> 00:01:10,240 I'm not gonna read the little part that gives it all away. 37 00:01:10,240 --> 00:01:11,080 Okay. 38 00:01:11,080 --> 00:01:14,240 On a stifling April afternoon in Anjmer, 39 00:01:14,240 --> 00:01:16,120 in the Indian state of Rajasthan, 40 00:01:16,120 --> 00:01:17,400 oh, this is like a story, 41 00:01:17,400 --> 00:01:20,760 local political shakti Singh Rathore 42 00:01:20,760 --> 00:01:24,000 sat down in front of a green screen to shoot a short video. 43 00:01:24,000 --> 00:01:25,240 He looked nervous. 44 00:01:25,240 --> 00:01:27,720 It was his time being cloned. 45 00:01:27,720 --> 00:01:29,480 Wearing a crisp white shirt 46 00:01:29,480 --> 00:01:31,880 and a ceremonial saffron scarf, 47 00:01:31,880 --> 00:01:35,280 wearing a lotus flower, the logo of the BJP, 48 00:01:35,280 --> 00:01:37,840 the country's ruling party, Rathore, 49 00:01:37,840 --> 00:01:39,200 pressed his palms together 50 00:01:39,200 --> 00:01:42,520 and greeted his audience in Hindu, Lamash Scar. 51 00:01:42,520 --> 00:01:44,280 He began to all my brothers. 52 00:01:44,280 --> 00:01:45,560 Before he could continue, 53 00:01:45,560 --> 00:01:48,000 the director of the shoot walked into the frame. 54 00:01:48,000 --> 00:01:51,800 Divyendra Singh Jadun, a 31 year old 55 00:01:51,800 --> 00:01:53,840 with a bald head and a thick black beard, 56 00:01:53,840 --> 00:01:56,720 told Rathore he was moving around too much on camera. 57 00:01:56,720 --> 00:02:00,200 Jadun was trying to capture enough audio and video data 58 00:02:00,200 --> 00:02:02,600 to build an AI deep fake of Rathore 59 00:02:02,600 --> 00:02:07,200 that would convince 300,000 potential voters around Anjmer 60 00:02:07,200 --> 00:02:10,560 that they had a personalized conversation with him. 61 00:02:10,560 --> 00:02:13,400 An excess movement would shake the algorithm. 62 00:02:13,400 --> 00:02:16,480 Jadun told his subject to look straight into the camera 63 00:02:16,480 --> 00:02:17,920 and move only his lips. 64 00:02:17,920 --> 00:02:19,320 Start again, he said. 65 00:02:19,320 --> 00:02:21,720 Right now, the world's largest democracy 66 00:02:21,720 --> 00:02:23,080 is going to the polls. 67 00:02:23,080 --> 00:02:25,920 Close to a billion Indians are eligible to vote 68 00:02:25,920 --> 00:02:28,200 as part of the country's general election. 69 00:02:28,200 --> 00:02:30,320 And deep fakes could play a decisive 70 00:02:30,320 --> 00:02:32,360 and potentially divisive role. 71 00:02:32,360 --> 00:02:35,040 India's political parties have exploited AI 72 00:02:35,040 --> 00:02:37,960 to warp reality through cheap audio fakes, 73 00:02:37,960 --> 00:02:40,440 propaganda images and AI parodies. 74 00:02:40,440 --> 00:02:42,880 But while the global discourse on deep fakes 75 00:02:42,880 --> 00:02:46,400 often focuses on misinformation, disinformation 76 00:02:46,400 --> 00:02:47,960 and other societal harms, 77 00:02:47,960 --> 00:02:50,760 many Indian politicians are using the technology 78 00:02:50,760 --> 00:02:53,000 for a different purpose, voter outreach. 79 00:02:53,000 --> 00:02:55,360 Across the ideological spectrum, 80 00:02:55,360 --> 00:02:57,640 they're relying on AI to navigate 81 00:02:57,640 --> 00:03:00,040 the nation's 22 official languages 82 00:03:00,040 --> 00:03:02,200 and thousands of regional dialects 83 00:03:02,200 --> 00:03:04,320 and to deliver personalized messages 84 00:03:04,320 --> 00:03:06,160 in farther flung communities. 85 00:03:06,160 --> 00:03:08,440 While the US recently made it illegal 86 00:03:08,440 --> 00:03:12,240 to use AI-generated voices for unsolicited calls, 87 00:03:12,240 --> 00:03:14,240 in India, sanctioned deep fakes 88 00:03:14,240 --> 00:03:18,520 have become a $60 million, Jesus, 89 00:03:18,520 --> 00:03:21,200 60 million business opportunity. 90 00:03:21,200 --> 00:03:24,840 More than 50 million AI-generated voice clone calls 91 00:03:24,840 --> 00:03:26,040 were made in two months, 92 00:03:26,040 --> 00:03:28,360 leading up to the start of the elections in April. 93 00:03:28,360 --> 00:03:30,760 Millions more will be made during the voting. 94 00:03:30,760 --> 00:03:34,040 One of the country's largest business messaging operators 95 00:03:34,040 --> 00:03:34,880 told IAR. 96 00:03:34,880 --> 00:03:38,080 Jadun is the poster boy of the burgeoning industry, 97 00:03:38,080 --> 00:03:41,560 his firm, fully mass synthetic media solutions. 98 00:03:41,560 --> 00:03:44,120 It's one of the many deep fakes service providers 99 00:03:44,120 --> 00:03:46,040 from across India that have emerged 100 00:03:46,040 --> 00:03:48,960 a cater to the political class. 101 00:03:48,960 --> 00:03:51,720 This election season, Jadun had delivered 102 00:03:51,720 --> 00:03:55,040 five AI campaigns so far for which his company 103 00:03:55,040 --> 00:03:58,360 has been paid a total of $55,000. 104 00:03:58,360 --> 00:04:00,480 He charges significantly less 105 00:04:00,480 --> 00:04:02,520 than the big political consultants, 106 00:04:02,520 --> 00:04:07,520 125,000 rupees, which is 1,500 to make a digital avatar 107 00:04:08,000 --> 00:04:11,520 and 60,000 rupees, which is $720. 108 00:04:11,520 --> 00:04:13,800 US, I'm a suiting, an audio clone. 109 00:04:13,800 --> 00:04:16,960 He's made deep fakes of Prem Singh Tamang, 110 00:04:16,960 --> 00:04:20,240 chief minister of the Himalayan state of Sikkim 111 00:04:20,240 --> 00:04:24,160 and resurrected YS Rajasera Reddy, 112 00:04:24,160 --> 00:04:27,360 an iconic politician who died in a helicopter crash 113 00:04:27,360 --> 00:04:29,880 in 2009 to endorse his son, 114 00:04:29,880 --> 00:04:34,000 YS Jagan Mohan Reddy, 115 00:04:34,000 --> 00:04:37,960 currently chief minister of the state of Andhra Pradesh. 116 00:04:37,960 --> 00:04:41,800 Jadun has also created AI generated propaganda songs 117 00:04:41,800 --> 00:04:44,480 for several politicians, including Tamang, 118 00:04:44,480 --> 00:04:46,360 a local candidate for parliament 119 00:04:46,360 --> 00:04:50,680 and the chief minister of the Western state of Maharashtra. 120 00:04:50,680 --> 00:04:53,200 He is our pride, ring one song in Hindi 121 00:04:53,200 --> 00:04:56,840 about a local political politician in Ashmer 122 00:04:56,840 --> 00:04:59,920 with male and female voices set to a peppy tune. 123 00:04:59,920 --> 00:05:01,960 He has always been impartial. 124 00:05:01,960 --> 00:05:04,960 It's weird that there's kind of like a give and take 125 00:05:04,960 --> 00:05:06,760 that's most good and bad for this. 126 00:05:06,760 --> 00:05:08,600 Like the fact that they can actually talk 127 00:05:08,600 --> 00:05:10,040 to people in all languages. 128 00:05:10,040 --> 00:05:11,000 Right? 129 00:05:11,000 --> 00:05:12,240 When they said that, I was like, 130 00:05:12,240 --> 00:05:14,160 okay, that seems like a good thing. 131 00:05:14,160 --> 00:05:17,160 But also they could hire people in those languages to help. 132 00:05:17,160 --> 00:05:18,160 Could they not? 133 00:05:18,160 --> 00:05:19,120 They could. 134 00:05:19,120 --> 00:05:20,480 It's just going to be the person 135 00:05:20,480 --> 00:05:21,480 not speaking their language. 136 00:05:21,480 --> 00:05:23,800 And it might be a misrepresentation to somebody 137 00:05:23,800 --> 00:05:26,200 but like, oh wow, they speak my language fluently. 138 00:05:26,200 --> 00:05:27,440 They understand me. 139 00:05:27,440 --> 00:05:28,280 Yeah. 140 00:05:28,280 --> 00:05:29,720 Which is a part of the good thing. 141 00:05:29,720 --> 00:05:31,960 Now I'm gonna just be honest with you. 142 00:05:31,960 --> 00:05:34,520 I'm not gonna read you the rest of this article 143 00:05:34,520 --> 00:05:36,680 because it goes on and on. 144 00:05:36,680 --> 00:05:39,400 There is much, much more to the article. 145 00:05:39,400 --> 00:05:42,640 I thought it was a very interesting article 146 00:05:42,640 --> 00:05:45,480 which I'm going to, you are going to link up 147 00:05:45,480 --> 00:05:46,640 in the show notes for this 148 00:05:46,640 --> 00:05:48,960 in case you want to have a more in depth read. 149 00:05:48,960 --> 00:05:53,960 I think more it was the idea of another country using AI 150 00:05:54,600 --> 00:05:57,120 and just the thought of that being a thing. 151 00:05:57,120 --> 00:05:58,360 And like Taylor just said, 152 00:05:58,360 --> 00:06:00,800 it has some good connotations to it. 153 00:06:00,800 --> 00:06:03,360 It also has some really bad connotations to it. 154 00:06:03,360 --> 00:06:05,240 If it gets any worse, we'll never know 155 00:06:05,240 --> 00:06:08,400 because we're not reading the rest of the article. 156 00:06:08,400 --> 00:06:10,000 I think we can know somewhat 157 00:06:10,000 --> 00:06:12,760 just because the Indian election happened last month. 158 00:06:12,760 --> 00:06:14,800 It is over, I think for the most part. 159 00:06:14,800 --> 00:06:18,440 Modi won but not as much as people thought he would win by. 160 00:06:18,440 --> 00:06:20,960 So I don't know how I played into that 161 00:06:20,960 --> 00:06:22,280 but that was kind of what was expected to happen. 162 00:06:22,280 --> 00:06:25,440 Well I like that you had kind of an update for us on that. 163 00:06:25,440 --> 00:06:27,680 But yeah, I thought it was really interesting 164 00:06:27,680 --> 00:06:31,840 seeing that article, which is why it made me so excited 165 00:06:31,840 --> 00:06:32,960 to be reading that. 166 00:06:32,960 --> 00:06:35,760 And I think we are feeling uncertain about that 167 00:06:35,760 --> 00:06:37,120 as I think where we left it. 168 00:06:37,120 --> 00:06:39,800 Yeah, it was fairly well posted 169 00:06:39,800 --> 00:06:40,640 in there. 170 00:06:40,640 --> 00:06:42,000 Another 100%. 171 00:06:42,000 --> 00:06:42,840 Look at that. 172 00:06:42,840 --> 00:06:45,040 And with that, you can all feel content for 48 hours 173 00:06:45,040 --> 00:06:47,760 that we have properly classified information. 174 00:06:47,760 --> 00:06:49,520 My filing is just a move away. 175 00:06:49,520 --> 00:07:10,360 Bye.