BSidesWLG 2017 - Simon Howard - Influencing Meat Puppets Through Memes

hi everyone well marks working right so I'm going to be talking about influencing meat puppets with memes so yeah my name is bogan keptin bogan to you today if you see me wandering around I have four babies three of them made of flesh and bone and still meet still baby here my debts and 120y with this owning a car like this people will stop me like I'll be at the traffic lights window down engine purring and someone will come up to me and tell me how they met their wife and they consummated their vows in the backseat of a car just like mine like people will leave love notes on my car I'll get back to the car

park and there'll be a love note and it won't be a love note for me it'll be a love note for my car I love your car your car's amazing give me a message any time you want to meet up and talk about cars so no very special and my family is also special [Laughter] yes so I when I was growing up I didn't really have much of an interest in politics my interest in politics would extend to doing [ __ ] like this yeah it was pretty basic really allegedly allegedly allegedly we also when I was at high school they were around election time there'd be lots and lots of these sort of billboards up and me and my

friends would come along and we allegedly would smash them all down and so in live legalized cannabis one standing of course my father was a police officer and one day I was at home and this sometimes his friends would come around and visit I knew who most of his friends were but one time this this officer came around to visit I did not know who this officer was my father told me to go and get the door and it turned out to be someone else's friend but I'm pretty sure because the police had stopped us after we'd done this and then given us a round of questioning were like oh we don't know what had happened

must have been someone else and beer he had found out that it was me and got a new officer to come round and heavily wechat and just got the shuts up me nothing actually happened but yeah okay so my presentation so after that as soon as sort of election started involving computers and technology and I'm not gonna be talking about election machine hacking or anything like that I'm more the social online side of it I'd started to pick my interest so today I'm going to talk about New Zealand election and we're going to look a bit about the u.s. election how to create your own troll army how to do this at home and then

some countermeasures that you might want to take right so we had an election recently we all know that and most of the advertising for that election was you would receive a colored piece of cardboard in your mailbox and didn't matter if you lived in South Auckland or why new Oh martyr or in Brooklyn you got the same piece of cardboard and it told you I don't know I just throw it in the but they also had some terrestrial television advertisements I don't know who watches that stuff anymore if it's not on youtube or on Netflix I'm not watching it newspaper again I think old people read that something they have them at cafes actually and you can a

yeah I am old yeah billboards again some social media but there was no real direct targeted advertising stuff we really enjoy and we had an election and just under our Odin was elected I'm pretty sure someone from the suit actually did this to Faceman I've seen them wearing those pirate t-shirts around and talking like pirates that may have been involved so there was some social media impact on stuff that Cota and Zed comments went through the roof the number of adverts appearing on Facebook so if you're in your only echo chamber with all your buddies who were labour supporters you might see some labour targeted advertisements but there's nothing untoward there's nothing like lock her up lock her up it was um

it was just like here's some great policies that we're implementing but want to implement so there was a guy down in Dunedin or there was a guy called David hood and he was actually conducting analysis on it so he was grabbing he he set up some bots to monitor all the different Twitter accounts he'd pull down all the tweets and he used our to do analysis on on all of these tweets to figure out if there was any one or any BOTS sort of operating in the New Zealand space and so this one here just taught her accounts talking about texts any PR people want to own up you can see these 20 tweets there is another one nerd rage

quantified so he had measured the sentiment around people talking about Steven Joyce and Bill English to see how angry they were about these people but again a really low number of tweets then he looked at links are so parties that were replying to themselves and you can see their New Zealand first is talking to themselves a lot which is not surprising everything we've got here he was analyzing also the links as well where people were feeding out to other articles and yeah not a great deal so we can sort of discern from that and from what I've talked to other people and that there wasn't much meddling going on in our local election the US however is

a different can of worms so political advertising over there is a huge huge thing Trump was mocked mercilessly for not spending money on traditional television ads like crooked Hillary was she spent a hundred forty million on television adverts where's Trump he's like you know I'm just gonna go on Facebook and he set up Trump TV which was some kind of livestream TV thing and after before and after the second debate he raked in nine million dollars and two hour time frame so instead of spending 140 million he made nine million it's a lot better right and what we didn't realize at the time that were Trump and his cronies were launching a multi-pronged attack so

it's a blitzkrieg of sorts was short fast what was next short but it was fast and it was powerful and they sort of sent the opposition into a tailspin they didn't know what to do and to accomplish this they used a puppet but not just one puppet lots of puppets sock puppets and these sock puppets were turning our ads like this or content like this or memes like this how to make America great again like if you agree so they're engaging with the audience they've got this shocking image there and that like if I show you most of these ads that they were creating it's probably some kind of code of conduct violation because they are horrific these this is

them in small format you can probably actually see those yeah but there's like people of Mexican people standing on main lines and blowing up in the air there's just horrible horrible racist disgusting adverts that these people created to try and force their message on the Americans so there's a person on Twitter who was analyzing from what was happening at there on the Twitter side of things and how many accounts were getting involved in it here they are searching followers for similarly named accounts 63,000 in 99 accounts and something looks a little bit strange about those accounts they look somewhat sequential and what happens when you register a torah account so say I'm registering Simon Howard F Simon has already taken will be

Simon Howard and then a series of random numbers and so if you're using a bot to automate Twitter account registration this is what it looks like so one of the largest nodes in their Twitter botnet was an account called David Joe and this account have been around for a while since 2013 and this one was predominantly aligned with UK manipulation so they looked at he looked at what time the account was tweeting from and so seems to be around Moscow time there I doing a 12-hour shift and we'll see a bit later on that they actually do operate 24/7 but this account maybe was one that being curated like so as there was someone's baby

they've been looking after this account for a long time and they didn't want to let any of the other analysts sort of jump on it so they just stood there did their tweeting during business time you can see from this picture here that they're they're tweeting around a variety of different topics so they start off in 2013 talking about their UKIP and then they talk about migrants and then around the brexit time the pink part of the graph there they're really ramping up the rhetoric about BRICS it is a bit of Trump mixed in there as well so you can see the the change in what they're talking about as the the agenda that they're trying to push changes and

all of this is happening from the troll factory or the internet research agency so this is a picture of their headquarters yeah in Russia they actually call it the troll Factory so they've got around 2.3 million dollars in operational expenses there's 90 staff working or there were 90 staff working fixed on this u.s. campaign 50 million subscribers a hundred million pageviews a week and from what's come out with these congressional hearings they head of around $400,000 in budget so 100k for Facebook Ads 270 K for Twitter ads Google Ads that we're never tossing on Google+ I did find out and I said yes and I think they've also doing a bit on red in buying some ridic gold in gilding

some stuff so it's like a goddamn comedy sketch a Russian troll sitting at his computer hmm what would an American drink coca-cola of course let's give them a six pack nice and overindulgent no breakfast baby from our world news on that that little quip yeah so they were that these Russians he just what's the American gonna live let's feed them something sex pack right so I've got me thinking what will it take to run something like this myself so you need to start with a good lead time so I started about three months out and then realized oh [ __ ] this isn't enough time to really make a good run of this and influence New Zealand election allegedly

so the Russians for the US election they started a year and a half out so you need to create a team get all your sock puppets running tailor your message deliver it and then monitor it to make sure that your message is having the device does desired effect so it can't be that hard right so our team so we need linguists who can write better English than I we need psychologists who can figure out how to tailor the message to play with people's minds we need the signers our cartoonists to create the content we need DevOps to manage all our infrastructure for all their proxies and all our nai machine learning infrastructure where we're going to start correct automating

the creation of some of our content and automating creation on his social media profiles that they stay live and they look legitimate and then we're probably going to need some hackers as well cuz everyone loves hackers and they help us bypass captures they help us figure out ways around the mechanisms that these companies are putting in place to detect these types of fake accounts so yeah everyone needs a hacker no no no so the u.s. put together a publication called JP 13 which the Chiefs of Staff said it's Navy and the Air Force and Army it's the information operations quite so they've actually written out a paper on how to plan prepare execute and assess

information operations and this is a really comprehensive document and it's awesome so if you want to go and run one of these campaigns yourself go and grab a copy that PDF and get stuck in if you do every clearance you may not be allowed to get it though so this is the information so that so this is how they run information operations and their Joint Chiefs of Staff so there's a lot a lot of moving parts there a lot of acronyms because they love acronyms you will notice here that legal is involved but we we're not going to need that where we're going yeah allegedly where we're going so this is my organizational structure yeah so

the cell chief kept in bogan here we've got a content creation lead and they're going to be in charge of the psychologist the linguist strategic so they're designer and artist and a meme consultant mr. mango PDF he's on board we had a lot of beers the other night well I had a lot of beers and he is yeah he's he's on board we've got a DevOps lead there and they're going to be looking after the DevOps resources email engineer ai engineer and a couple of hackers as well and then who else to lead a troll army but the one in only its just 23 yeah so you really have a couple of trolls under them yeah so we're building chaos IT

city here is anyone seeing this episode of South Park yeah it's great right so we want to build our team on the cheap right I don't want to spend like lots and lots of money I don't have a 2.3 million dollar budget so I'm going to outsource all these positions to contractors on so you can use Elance or I think Elance has changed to something else now freelancer decoding Zeid in conduct all your online interviews and then pay everyone in Bitcoin because we want to UM or some other pepto hipster cryptocurrency of the day because we want to very kind of anonymous so this xbt freelancer we can go and find these types of resources and pay them in

bitcoins all right this is I am the actual the salary of forty to fifty thousand rubles with the schedule of work from 20 100 200 900 in the office in the Primorsky district job duties include writing on the given topic news information and analytical employee skills our free English including confident position of written language and creativity yeah so they were actually advertising on super job that are you for trolls this is a troll advert this is what one looks like this is how I hired Steven so the sock puppet account creation we need to take some appropriate opposite countermeasures as well to create this account so fake name generator' calm was great you put in you

choose an ethnicity you choose a gender you can choose an age and it will populate all these details and then you can just go and plunk them straight into your social media account and it'll give legitimate addresses and workplaces in their area as well where it's chosen things so you don't need to think about anything it's really neat when you're choosing their birth date on your sock puppets make sure it's not the first to the first nineteen seventeen or thirty first to the twelfth because they look kind of dodgy when you're looking for automated accounts or or these types of maliciously created accounts Beck stop some family members there too so if you're looking in a social media profile

and there's your name's John Smith and there's no Jane Smith and Mary Smith as cousins or family members then that's going to look a bit dodgy it will depend on how deep your cover is going to be investigated to how far you need to go with the spec stopping but you want to do a fairly half-ass job of it so consider the purpose for which the profile photograph has been used as well and the source of that photograph so one of the most of the fake accounts are on Facebook someone's just gone to a pornography website taking a picture of a girl and then put that straight into their profile and like chopped it off

here and as soon as you do a reverse image search for that photo you see it leads back to all this pornography so Facebook can also do those reverse image searches and then lead back to the account and figure out that's a fake account protip just flipped the picture and then upload it and then reverse them and research won't bring up anything also make sure that you choose an address that exists in your profile so a couple of years ago at Kiwi con we had some ticket online ticket purchases and this is when we'd integrated PayPal and the fraud detection system came out like flashing lights fraud fraud fraud someone had purchased some tickets with

their their billing addresses one two three fake Street we went and looked at all the accounts that had been registered under that name and then we're like hmm pretty sure we know who this is and think middle or someone flicked off a quick email and then yeah there was some very embarrassed people that they all their pseudonyms had been unmasked the person who actually created the ad actually paid for the tickets and use their fake address this picture was printed out and put on the cubicle wall for him to remember OPSEC right so opposite countermeasures you need proxies obviously you don't want all of your if you're managing a hundred accounts you don't want them all

to come out of your home IP address that's a bad idea so you need proxies you need to spin them up on a do various or something somewhere that where you can still log into Facebook from burner phones as well you can use Tulio so Tulio is a pretty neat service we can just sign up and get a SMS number because you want to use SMS to bolster the validity of your profile or you want to implement 2fi on your profiles to make them seem more legitimate Tulio doesn't support it's a Miss for New Zealand numbers so if you're creating New Zealand profiles you probably want New Zealand SMS numbers to go with them so you could

always create your own SMS service right then you need basic can't so I'm using outlook for my feeder accounts and then creating the Facebook and Twitter and stuff from using the outlook commentaries as a feeder you don't want like dodgy hacker at mail and a comb or some other like shitty service that's going to get blacklisted really quickly or already is blacklisted so for the 2fa part i didn't want to pay for Twilio cuz I'm cheap and also I wanted to figure out a nice solution to this so I looked at the some 800 see which is like a little basically a cellular modem and they're pretty cheap but then you need to worry about how to get there the

serial line out of it and there was going to be a bit of a problem so I went with USB modems and I managed I found that some one on trade me who was selling ten of them for $90 and he said I had heaps of them so he gave me 20 for $90 so they ended up in $4 fifty each some cards again I found someone on trade me if you go to Vodafone shop and you want a new SIM card it costs five dollars I think it's like that's ridiculous so I found someone online who has got an unlimited supply of Vodafone SIM cards and selling them for 50 cents each and again I purchased ten or

fifteen of those and then it came there's like 20 or 25 in there and the envelopes I'm not sure I'm just getting free stuff it's great you need a USB hub as well to run the stuff so because each one of these modems I think they draw about 500 milliamps so you it's hard to find a USB hub that can go bigger than three amps yeah I'm not really sure why I did talk to Finch him about this yeah and there can be as but as a bonus you can use this little rig to spam your friends so you can't actually run that mini and hub but it looks really cool fully populated doesn't it there's some

really neat software that's already been developed for this purpose so you can just use soak it and then like pipe 80 commands directly into the div TTY you speed zero or you can use SMS server tools number three with all your gsm modems they all register as USB devices and then there's a handle of the air there is just running eighty commands to all the modems constantly and saying hey have you got a new message here we've got a new message as soon as it gets a new message it pops it into a spalling folder and then you can then read the messages out of spalling folder and then like freed them into something else it's

automatically putting them into your Facebook account right so if you're creating lots of accounts using the mobile version of any site like mobile version of Facebook mobile version of Twitter it's a lot more cut down and you can scrape it and you can automate a lot easier so selenium or grease monkey for that you can also allegedly steel exhaust accounts from dumps but they're probably going to get shot down after but after a number of time amount of time because Facebook they'll be monitoring those dumps as well and they'll figure out all these accounts have been compromised as it shut them down managing lots of social media accounts is a pain in the backside so

there are some tools you can use to do this however there's HootSuite and buffer and they're good HootSuite for a I think it's free when you're up to five accounts but anything more than that you have to start paying money and these companies are probably going to be compliant with law enforcement requests and plus it changes their like when you see posts on Facebook you can see it's been posted by HootSuite however there's another bit of software which is far less likely to help out law enforcement it's called monster social it's basically a bot management platform and it works with Facebook Instagram Pinterest Tumblr Twitter it's really really neat and you can do a lot of cool

stuff with them so when you are creating these sockpuppet accounts Facebook I'm not sure what their triggers are and it would take quite a while to figure out what they are but if it looks dodgy you're going to get challenged so the account will get locked and then you get asked to send a recent pic of yourself I've only got one pack of this person who have used created the fake account from and I flipped it so I just take the unfurl up version and then send it up and then my account gets unlocked again using tor fa will also provide validity to your profile as I mentioned before so you might when he gets locked it might

be like hey we've seen some some dodgy behavior on your account he a you okay Simon are you still there I sure AM just send me a semester my bank of modems and I'll sort you out so the troll factory came across similar problems and there's a really great I could only really I couldn't find much information about the the troll Factory except there's a Russian site where that interviewed some of the ex employees and it's in Russian so I had to translator well using Google Translate I didn't mean you ly go and learn Russian and then translate it and so when Facebook blocks accounts of trolls the IT department my Russian accents terrible I'm not even going to try I got a friend

to record it but before so they buy a proxy server issue new IP addresses virtual oasis and the work begins anew and also some cards or cloud numbers are purchased and new payments accounts are open so my methodology is following this seems to be good so far so with a sock account sock puppet accounts you to tailor your profile so you need to match your profiles to the personality types you need so someone who will resonate with their new friends and to do this I've been using ocean personality test so based on what you like and what you post you can figure out if someone's an extrovert or very agreeable or slightly neurotic people say but by Hogan the

ocean personality test it's it's a load of junk it only caters for 56% of the population it doesn't account for thriftiness na nastiness tanned sense of humor all these other things but if it's good enough for Cambridge analytic a it's good enough for me suppose you don't know Cambridge unless you are a global election management agency offshoot of ECL group and patterned by Robert Mercer who helped funds his buddy Steve Benin and Breitbart news it took me a long time to find a smiling picture of Steve Benin all of them are like the grumpy cat like down-tuned face it's very sad man but he is smiling lovely smile in this photo so Cambridge analytic a has between

3,000 and 5,000 data points on every American which is terrifying they know their age that income their debt their hobbies criminal history gun ownership some of its collected by them by scraping social media and they just purchasing it bulk from all these other American suppliers as well and they assisted with Brixton and Trump campaigns in currently under investigation by the house Parliament Select Committee on Intelligence so in order to profile yourself to figure out what your ocean score as the Cambridge University which is funnily enough where Cambridge analytical grew out of they've got an API called magic sauce so you can obtain obtained a list of your profile like some posts and you can either use

give it access to your account or you can just manually get their data and pump it into the API and once your profile type is known you can start to friend people with similar profile types and we need to keep this method later for when we're doing a dark Ed's so my personality type of my fake account was organized and hard-working story I know I wasn't even trying to make it like that I just knew just knew it also estimated that my profile age type as 12 [Applause] it's mainly because I was doing what kind of cat are you surveys so centers of influence we need to figure out where we're going to spread a message to so

figuring out numbers of how many New Zealanders are using social media is quite tricky Facebook reckon they've got about 2.9 million New Zealand users each of them spent visit Facebook 14 times a day washing their brain for 15 minutes twitter has around 500,000 Instagram and ye old stuff comments center of influence we also figuring out because we're going to be targeting targeting specific electorates in New Zealand because each electorate down south they're a little bit more different where we are up north so Parliament indeed website has got a lot of great demographic information as well which we could feed in getting some friends so Facebook location search will allow you to figure out where your new

friends are going to come from we can see here some people in Gore Southland working at KFC and doing a whole lot of if all unemployed and he spell unemployed wrong yeah used to be able to use the API to do this but now you have to scrape you're using the way by UI which is a bit annoying and this is what once the social looks like doing friends I'm gonna make them suggest every single one of their friends at whatever account I choose now in this demonstration I'm going to be making them add Kai Davidson I'm gonna put card over since the URL in the program here and now it's gonna start logging it's all these accounts at

once and it's gotta start sending suggestions so fetching receivers if we have a look it's starting to send suggestions so what's gonna happen is every single one of these people that are coming up right now are going to get a suggestion it's gonna come up in their little friends box right here telling them to add them yeah look you can do this manually if you want but you can also do with Monster social as you can see what I'm doing here and I'm doing this many at once now have a look at this 117 friends like so that was pretty quick so for every so he's only running like six or seven fake accounts there

and each one of those has got five thousand a thousand also 500 a thousand 1,500 friends they all get suggested to add this new account and then suddenly they're newer counters like if I let their video run for longer it goes 100 200 300 and pretty soon like within a few seconds we've got 500 friends on that account and so the ability to ramp up and create your sock puppet army once you've got a few feeder accounts you can just start going nuts it's ridiculous and that's just that suggests a friend feature of Facebook hurting your straps so one of the fake accounts I was running I created I started adding a few people and people just accept your

friend requests we all know the song on Facebook because they want to be liked they want to have more friends than their friend and as soon as you get into the bot networks because there's lots of existing bot networks out there then you that the friend will Chris just start flying and so one morning I had added some people with um or some BOTS effectively and then they had then suggested out to their bot network say this person's accepting these friend requests and then like a next morning I wake up and there's like 228 new requests in 219 and then if I add all of those to my account then I'll have 500 new friend requests and within a period

of a week you can probably get to the 5,000 free and limit pretty bloody quickly creation of content so program voter who's ocean score ranked some higher neuroticism could see storm clouds in a threat the Dimmick wants to take its guns away so we want to create content like that we want to make people scared and so Facebook allegedly so Facebook split-testing helps you do this they help you tester for an ads see what kind of impact they're going to have and see who's going to click on stuff and do things so the Hilton Hotel chain use this exact technique to run some adverts that they were doing to see which types of people were clicking on ads and so if you've

got someone with high extraversion they're and they're very open and keen on doing things then let's give them an ad with someone's like whacking a volleyball and outside with their shirt off and like high-fives all around and then if someone's very agreeable they're probably won an ad were you wearing a cardigan you've got like some you've got like a family situation and things are a lot more relaxed none of this energetic like jumping in volleyball stuff so we don't really want to leave a financial trail so if I can get some free campaigns I will and every now and again like my Google inbox is saying hey here's some more adwords or free edward campaigns and there'll be

for like $150 so you want to jump on as many of those as you can but direct marketing via posting of contents the way to go as well so using your follower base to push your particular message you want to send different adverts to or dark advertising as a concept of sending different adverts to different target audience groups will be disadvantageous for a group a to see group these ads so the way to do that to target it directly is using that magic sauce again we're going to harvest air targets likes via scraping which will give us their ocean personality type plugged into magic sauce and target them directly so the way cambridge and love could do this is

there have you ever seen those personality tests or see what topic 8 a.m. they run a lot of those campaigns and they have a store that information they've already got your profile ID and that's how they figure this stuff out so we're just going to do it manually and again using the mobile version of the site this is what someone's likes look like on the mobile version and then you can just take all the href links and you've got all the likes simple and then we wait so we measure it so IBM Watson's got the natural language API which does nearly mystic programming stuff and figures out sentiment emotion keywords and entities so you can as you campaigns

running you can see how people are talking about it and measure how effective it is becoming then go and adapt your message and get rolling all right so this is all bad what kind of countermeasures can we take always like like having an idea of like how we can possibly fix this horrible horrible situation so we're building these Silicon Valley platforms that set up to optimize for self radical a radicalization the way forward is for US citizens of the internet and that's what we all are to educate ourselves and their families that what we're seeing through Facebook newsfeed is created with it as by human or computer and to understand the difference between an ad

and our organic story from your friends it's something and sometimes it's hard to tell that's a lovely sentiment met but that made me cry rainbow tears of laughter because it's just not going to happen we're not gonna be able to tell everyone hey like you know Facebook's bared and like we shouldn't listen to these ads we don't know if they're real or not we need a stronger approach I think regulators like their literal Electoral Commission would always be playing catch-up when it came to regulating emerging technology so we can't sort of regulate our way out of this problem long term maybe this is something we need to look at as a society and say well if this is our view of the world

and it's been controlled by some publicly listed company in California do we want some control of some transparency around that very wise word from the goat farm so Facebook made forty four billion dollars in ad revenue in the past two years that's an obscene amount of money the famous Patrick Kate gray said they've replaced human creation with automated creation to fix this need to fundamentally change the model which is right and they interviewed a lady on her show who said you can still be super wealthy but not minting at that current speed they have been minting at the speed and not paying for any of the externalities involved in it you wouldn't let a company do something just

because they're used to making a lot of money unless you're a shareholder of course then you can keep going maybe they aren't meant to be this profitable right maybe instead of making forty four billion dollars maybe they could just make twenty billion dollars and do a better job of curating the ads that come on their platform there's a German outfit called who targets not me and they tell you which political campaigns used arcades and micro targeting to influence your vote and they do this with a browser and Sten ssin that collects all your ads that are coming on the Facebook platform they feed it into a big machine learning AI thing and and figure out what what's going on and I

was messaging them on Twitter last night saying hey and this is a Chindi pipes about this as well what about if they took all those ads and they saw that they were their dodgy effectively if they just feed that straight back into Facebook is into a reporting mechanism and then make it Facebook's problem again there's a German Marshall Fund so the Germans have really forward-thinking in this space they actually I've got a good sense of democracy I suppose and they want to make sure that it is secured so they're monitoring around 600 Twitter accounts a link to the the Russian influence operations at the moment and they're figuring out what topics are talking about what type of

hashtags are posting URLs that they're sending out yeah they're doing a really neat job of this but 602 lyric ants is only the tip of the iceberg where we saw before there was 63,000 accounts that were splitting out this this news there's the Facebook ad police so Facebook of recently this was off the back of the congressional hearings into the how Russia was manipulating the elections so they've hired two hundred and fifty people now to police adverts on the site they're notifying tens of millions of users this is just the other day they put out the statement so if you have liked or followed one of those Russian influence accounts they're going to notify you and say hey Simon

by the way member their ad you saw six months ago well that was the Russians and they're also implementing mechanisms to detect fake news so AI manual fact-checking so they it's a small a small step but hopefully we'll see this capability grow Twitter as well doing a great job as always and everyone celebrates the two hundred eighty characters meanwhile Twitter verified another white supremacist so what can we do delete Facebook delete Twitter go outside and play in the sunshine yeah I don't know I think that yeah forcing these big companies to do better is what we need to do make this money do better curate this content and and stop this from happening again because there's a war out there old

friend a world war it's not about who got the most bullets it's about who controls the information so I will be running for the 2021 election

good thank you [Applause]