The risk of malicious actors using powerful AI decision tools is significant. The most effective countermeasure is not to restrict the technology, but to ensure it is widely and equitably distributed. This prevents any single group from gaining a dangerous strategic advantage over others.
This field is too immature for a standard career path with many job openings. Contributing effectively requires an entrepreneurial mindset to identify needs, create novel projects, and build solutions from the ground up, as opposed to simply applying for established roles.
Instead of only slowing down risky AI, a key strategy is to accelerate beneficial technologies like decision-making tools. This 'differential technology development' aims to equip humanity with better cognitive tools before the most dangerous AI capabilities emerge, improving our odds of a safe transition.
You don't need to be an AI engineer today to contribute later. Strategic career paths include founding any tech company to learn entrepreneurial skills, gaining expertise in fields like diplomacy or forecasting, or joining key government institutions to be ready to integrate these tools when they arrive.
Even if the market would eventually build decision-making tools, their impact is time-sensitive. Waiting for commercial rollout might mean they arrive after AGI, too late to help navigate the riskiest period. Therefore, philanthropic or impact-driven acceleration, even by a few months, is highly valuable.
Impactful AI for societal decision-making can be categorized into two main types. Epistemic tools help us understand what is true (e.g., AI fact-checkers, forecasters), while coordination tools help groups cooperate (e.g., AI negotiators, verification systems). This provides a clear framework for targeted development.