Yeah, even though last August, when our ministry first started, the same hour as our website went online, missiles flew over our heads following Speaker Pelosi’s visit. That was just that day, but every day, according to our National Security Council, there’s five million cyber-attack attempts on our network, and ...

Hi, I’m Audrey Tang, I’m a digital minister. I’m a non-binary minister, not just in gender, but also parties and really everything. I take all the sides.

Okay, thank you. Live long and prosper. Bye for now.

Currently, we don’t have that capability in our radar. I think none of us have because these risks only manifest when it touches the society. And so how to make sure that this impact is done in a way with the full forecasting capabilities of the standard-setting bodies and their ...

This is a direction I think Anthropic and even Meta is now moving very heavily toward, as you know. So I’m eager to hear what Open Data thinks on this particular direction. And but we’ll continue to run our local alignment assemblies. We run two already and there’s probably three ...

Second, we will also want to share our democratic input and democratic alignment with you. I understand that the CIP have already worked with OpenAI very successfully, I would say, on the 1,000 people across the US statistically representative, deliberative polling, and that leads to a Zoom conversation, right? That ...

Okay, right, so on my end, I think the action items, just to very quickly recap, are three, right? We will send materials and double down on our language and epistemic justice evals, and we look forward to hearing from you after the meeting on what’s the latest thinking on ...

She’s in charge of not just the Mandarin translation of the book, but also a lot of the like conceptual mapping, strategic mapping for the book.

Yeah, excellent. So any questions from our three advisors? Maybe if you’re still around, maybe you can do a quick round of introductions. Any quick questions?

And I understand Sam has been kind of pivoting toward this direction in the past three months. He used to talk about superalignment in a more traditional singularitarian sense. But now I believe he publicly says that he believes that this democratic co-creation is actually the way to go because ...

I mean, like if you look at augmented deliberation on the middle of the new wave, it’s more intimate than the previous generation’s intimacy and includes more people than capitalism, right? So the idea is to push the boundaries to not make trade-offs. And in this, we can say, after ...

Yeah, I think this actually connects very well to the democratic input that we just talked about. Because the idea is that after alignment assembly, people, a community, a country, or even just a company, can push the boundaries of their own understanding of themselves, basically. So using this plurality ...

I wonder if you want to do more, because obviously you can do more. We heard about plans of a smaller, narrower models being released as open weights on Hugging Face and things like that, but I don’t think anything ever come off from that angle. And I wonder why, ...

So this is a very strong pro-edge AI guideline in our cabinet level guideline for Gen AI use in public sector. And as a direct result, the investment on hardware will increase because then each intranet will have to have its own compute resources for inference and quantized fine-tuning. And ...

Yeah, certainly. So I’ve been running very large language models on my MacBook M2 with 96 gig RAM and it runs even Falcon 180b, sufficiently quantized. So I am a big believer in edge AI. I think without ongoing breakthroughs at homomorphic encryption, other ZK chips, edge AI is the ...

And although we hear that 20% of compute in OpenAI is going into super alignment, it’s not very visible from the outside… So to seriously increase the investment on democratizing evals, I think that is a touch point that both you and we can make visible progress together because it ...

Yeah. And I think the main thing we’re being asked by our population and constituents and MPs is just whether there’s a benchmark. Can we objectively say that this is the limit of prompt engineering, this is the limit of custom instructions. You really cannot squeeze any more language understanding ...

Yeah, yeah. So my conversations with some of your research team members are actually public. So we did talk about that when they visited Taiwan.

And we can help. Taiwanese researchers did help Meta on a speech-to-speech Taigi-English translation model that’s on Hugging Face. And I think that’s very powerful. But currently there’s no pipeline to integrate any of those research, either as a pre-filter, a post-filter, a split learning, fine tuning. There’s many ways ...

I understand you made a deal or at least an agreement with Japan on OpenAI, for the ChatGPT models. These models can speak Japanese just fine, but whether they recognize the Japanese culture or not is another matter altogether. And so I think this kind of cultural tuning, cultural consciousness ...

Yeah, so I don’t remember whether I’ve sent you the slides we did in the Sunday meeting about certification and evaluation and alignment assembly. If not, let the team follow up on that. We’ve got three advisors of cybersecurity here. And we also want to engage on the linguistic and ...

So if you go to GitHub and search for plurality, that is a more academic way to document such things. And basically, the idea is we want to, over the spectrum of intimacy to wider conversations, to delineate several work domains, basically, from intimate conversations to deliberations and all the ...

Yeah, with an economist — although he probably describe himself as a pluralist now — Glen Weyl of Microsoft Research and it’s called plurality.net.

Yeah, we’re writing a book about that.

So if we can find out a way to use multi-modal models to compress without losing nuance as a unit of a particular assembly, then it can enable very, very interesting queries. For example, you can join a discussion group after the fact with new information and with new queries ...

I believe the fundamental error here is to analyze on the unit of an individual. If you aggregate individual signals, no matter how you measure, you lose the plurality that is imbued in community interactions. And so we argue that the smallest unit of alignment assembly should not be an ...

And so I understand that, you know, if everybody does this with, you know, Vision Pro, right, or Quest, or whatever, you can capture some of that, but still it’s a very shallow proxy and you end up having to extrapolate. That is to say, to based on very limited ...

I mean, with multimodality, that’s really, really good that you have introduced in such a kind of staggered release, making it comfortable with one community and the next community. Multimodality enables post symbolic communication between communities. The idea, very simply put, is that in a democratic conversation, if it’s face-to-face ...

On the other hand, if we don’t democratize this kind of sensing through data altruism organizations, you don’t get the unknown unknowns of the dangers. So I mean, this is something that’s knotty to resolve and probably can only be resolved with global coordination. But I think this is fundamentally ...

Because the other metaphor you sometimes hear is the ozone-freon or climate change metaphor. People are polluting the information landscape and we have to think of compounds that does not pollute. That’s where the provenance/watermarking conversation is coming in from that metaphor, but there’s something fundamentally different in that everybody ...

Yeah, we’ve advocated in APEC privacy enhancing technologies, specifically zero-knowledge technologies. We’re going to publish domestic guidelines for PETs as well as data altruism organizations by the end of the year. We strongly believe that the DAOs — not that DAO, this DAO — Data Altruism Organizations is the key ...

And this is fundamentally what Alignment Assemblies is about, is the art of people in a community having a voice, even fine-tuning their LoRa that solves cultural misalignment issues like we heard about the anti-Muslim bias in the ChatGPT model and things like that. So that nothing about the community ...

I’ve always pushed for the cybersecurity metaphor. And that requires something that is like the emergency response team, the CERT, the SOC, the ISAC, the post-release product incident response PSIRT, and so on, which I’m sure you’re already aware of. And I think this week I’m happy to hear that ...

In cybersecurity, you assume breach, you assume there will be vulnerabilities, you assume that through open bug bounties, cyber drills, people working together, responsible disclosure, planning for buffering — the Anthropic idea of buffering for six times more vulnerabilities and so on safety margins. All this is risk management. But ...

Yes, certainly. I mean, I’ve long argued for open red teaming for the frontier models, to basically adopt the cybersecurity mentality rather than just non-proliferation mentality, which is a very different metaphor for most of the things.

So in short, participation, progress, and safety, this triangle is my job to increase the overlapping of these three values without making sacrifices or trade-off, because the time you start making trade-offs, you stop pushing the boundaries of how emerging technology can be used in service of democracy. I hope ...

So we’re also working on a certification and evaluation center to the end of the year to highlight upcoming threats. And Taiwan has good track record in that. As you know, during the three years of pandemic, we never locked down. People always can move from city to city. And ...

And finally, I’m also chair of the National Institute of Cyber Security and I also oversee the Administration for Cyber Security. As we all know, the information hazards, the synthetic information, the defeating of watermarking by open source models up to, I believe, 300 tokens now are completely paraphrased, needs ...

And underneath my ministry, there’s administration for digital industries, which is for the progress part. So popularizing AI, especially edge AI, things that run on the edge, that protects the privacy and security, or investing in homomorphic encryption and zero-knowledge technologies that let, for example, OpenAI to retain the model ...

Great. And as communicated previously, we will not publish any of this recording, but we will make a transcript, we will co-edit before publishing. So feel free to remove any bits that you consider sensitive, including your questions. So, yeah, maybe the easiest way to start is to start with ...

Yes, of course.

Okay, well, enjoy your stay and see you next time. Thank you.

Okay, that’s great. The typhoon is… one of the silver linings of a typhoon is that it brings people together.

Next time when you come, I have three offices. So the third one is very close to Kaohsiung. It’s in Shalun. Just outside of the high-speed rail station. So if you visit Kaohsiung and happen to be around, [laughter] the food is much better. [laughter]

I think we need to get the interagency clarity figured out first. Then we will also talk to the FAA about their preferred way for our statements to be relayed by them, or we make our own statements or we do some consultation. We don’t know, right? So we will ...

Yes.

It would be great if you could come. Or at least come to talk to the industry about some of these options.

The central government must make rules that apply to the entire country. We cannot be playing favorites. If we do a policy that benefits only a handful of operators within a specific municipality, then we will be criticized as over-favoring a municipality. For a municipal government to do that, what ...