As artificial intelligence governance and media ethics evolve, the long-held ideal of journalistic objectivity — once epitomized by figures like Walter Cronkite — must give way to a more engaged form of knowledge brokering.

Passive Objectivity Is Over.

In an era of fragmented narratives and competing truths, the challenge is not merely one of providing more facts, explanations, or predictive models but of addressing the absence of a shared interpretive framework. Without a common basis for understanding, the question is not just what we know but how we move forward as a society.

Similarly, as humans, we must confront the limitations of artificial intelligence (AI) regarding the artifice of neutrality. Both AI and human institutions often resist acknowledging the inevitability of conflict, operating under the assumption that harmony can be engineered through perfect information or impartial arbitration; this is a fundamental miscalculation. Human interests are inherently divergent, and societal tensions are not problems to be “solved” but dynamics to be navigated.

This misguided pursuit of neutrality manifests in several ways. In its authoritarian form, it justifies suppression in the name of order; in its technocratic form, it assumes that rational expertise alone can override deep-seated political and cultural divisions; and in journalism, it often disguises power dynamics and moral stakes under a false pretense of objectivity.

Yet all of these approaches share a common flaw: they treat conflict as an aberration rather than an intrinsic feature of democratic life. True stability does not come from erasing conflict but from structuring it, engaging with it, and negotiating power in a way that preserves both liberty and order.

Neutrality as Control, Conflict as Democracy.

Rather than avoiding conflict, artificial intelligence, political technology, and news media must be designed to mediate and structure it — just as James Madison envisioned in The Federalist Papers. Federalist №10 and Federalist №51 offer a critical blueprint for managing factionalism, balancing competing interests, and embedding conflict within a system that prevents any single faction from overwhelming the rest. This Madisonian insight remains just as relevant today: democracy is not about eliminating division but about institutionalizing the mechanisms that allow it to coexist with stability.

AI and journalism must evolve beyond their reluctance to acknowledge conflict, moving away from the illusion of neutrality and toward a more honest engagement with the realities of power, factionalism, and political negotiation.

Liberty without order is chaos; order without liberty is tyranny. Democracy lives between these extremes.

A functioning democracy is not one without conflict — it refuses to suppress it while ensuring it does not become destructive. This balancing act reflects the principle of Ordered Liberty — a framework in which individual freedoms are protected within a structure that sustains social order and democratic integrity.

Justice Benjamin Cardozo, in Palko v. Connecticut (1937), introduced the concept of ‘ordered liberty,’ asserting that fundamental rights exist within a framework of societal order. This principle underscores that while liberty is essential, its preservation requires a structure that upholds both individual freedoms and the public good.

Alexis de Tocqueville also noted that democratic vitality stems from the tension between individualism and collective responsibility, warning that suppressing difference leads to apathy or the “tyranny of the majority.”

In his influential work, “Democracy in America,” de Tocqueville explains “tyranny of the majority” as a situation where the majority’s unchecked power in a democracy can lead to the suppression of minority rights and opinions, effectively creating a form of oppression that undermines the very principles of freedom and equality.

In the United States, democracy isn’t about eliminating conflict but about managing it constructively. Disagreement is natural and even essential in a free society.

The erosion of professional fact-checking, as highlighted by Meta’s recent decision to discontinue partnerships with trusted organizations, exemplifies a more profound crisis in the digital information ecosystem.

The challenge lies in the irreconcilability of moral and ethical worldviews, where even the concept of “truth” is often shaped by identity, experience, and ideology. When used wisely, Artificial Intelligence (AI) offers a unique opportunity to mediate this raw, often contentious fact— humans disagree.

AI’s strength lies not only in its capacity for scale but in its neutrality, enabling it to analyze vast amounts of data while bypassing the emotional entanglements that often cloud human judgment. By cross-referencing claims against trusted databases and logic patterns, AI can offer a baseline of verifiable facts.

However, in a world where no one seems to desire "truth” to be universal—preferring instead affirmations of their worldview and perspective founded in beliefs about “what is best”—AI can transcend simply enforcing factual accuracy and it can be used as a tool for fostering understanding— this is beyond explanation and prediction. But, humans must enable AI to do so.

Ultimately, AI’s success depends on ethical oversight and balancing automation and human values. By mediating rather than dictating, AI can foster trust, not in an absolute truth, but in the collective pursuit of understanding in a fractured world.

Ultimately, explanation and prediction differ from interpretation and understanding—because meaning is central to fact, and AI’s greatest role may be helping humanity navigate the complex interplay between facts and the diverse meanings we ascribe to them.

The emergence of AI mediation systems like the "Habermas Machine" reveals a deeper crisis in our digital age. While these systems promise to help humans find common ground, they enter a world where the very infrastructure of truth and knowledge is contested territory. Digital platforms aren't simply neutral spaces for deliberation and finding common ground, but they are a battleground where different groups fight to control how reality itself is understood and verified.

This core tension extends beyond what we might call the mediation paradox - where our ideological divisions require computational assistance beyond human comprehension. Recent research shows AI systems can successfully mediate group deliberation where direct human interaction fails. Yet this apparent success masks a more fundamental question: How can AI mediate between groups who inhabit different belief systems and epistemic architectures, each with their own ways of determining and verifying truth?

The materiality problem in our digital age presents a fundamental paradox. While material mediations shape human subjectivity – our interactions with objects, tools, and physical infrastructure – these mediations have now become sites of active ideological warfare. Digital platforms aren't neutral spaces where different viewpoints naturally converge; they are contested battlegrounds where reality itself is actively constructed and fought over.

Consider Musk's transformation of Twitter into X: this isn't merely a change in ownership but a deliberate reconfiguration of an epistemic architecture.

By altering verification systems, content moderation, and algorithmic priorities, this move demonstrates how control of digital infrastructure means control over how truth is verified, distributed, and legitimized. Different ideological groups don't just hold different beliefs - they inhabit entirely different digital ecosystems with distinct ways of knowing and experiencing reality.

This transforms our question about AI mediation. It's no longer simply about whether AI can help bridge differences but whether AI mediation systems can function effectively in a world where the very infrastructure of knowledge is contested territory. Can AI help reconcile fundamentally different epistemic architectures, or will it reinforce these divisions? We face a race between technological development and philosophical understanding and a challenge to the possibility of shared truth in digitally mediated space.

Moving forward requires reconceptualizing both human agency and democratic deliberation within this contested digital landscape. Rather than seeing AI mediation as either a threat or a solution, we must understand it as part of knowledge production and verification infrastructure. This suggests developing hybrid systems that aren't just about combining human judgment with computational assistance but about creating new epistemic architectures that can acknowledge and potentially bridge these fundamental divisions in how different groups understand and verify reality.

This contested digital landscape demands new philosophical frameworks that go beyond traditional understandings of materiality and mediation. We need new theories to explain how different systems of knowledge and truth-verification emerge, compete, and might coexist in digital spaces. These frameworks must recognize a crucial fact: the infrastructure of knowledge itself - from social media platforms to AI systems - has become the primary battlefield in ideological struggles.

As Mill observed about the ideological conflicts of his time, between opposing parties, there exists a 'bellum internecinum' (a war of mutual extermination), where one side sees its opponents as 'beasts' while the other condemns its rivals as 'lunatics' (Mill, 1840, p. 405). But today, this war isn't just about conflicting beliefs - it's about controlling the very architecture through which reality is constructed and verified.

The challenge isn't simply technical or philosophical but fundamentally about power and control over the architectures of truth. While AI offers tools for mediating disagreement, we must always ask: Who controls these systems? Whose epistemological framework do they privilege? How can they function when the very ground of shared reality is contested? We need ways to harness AI's mediating capabilities while ensuring they don't become another weapon in epistemic warfare.

Moving forward, we must face a brutal truth at some point: no amount of code will make people join hands and sing kumbaya. Technology won't save us from our very human selves. The sooner we abandon the fairy tale, the sooner we can deal with the reality of human conflict in all its sharp-edged glory is an ever-present aspect of our “reality”.

Instead, we must develop systems that can operate effectively within and across competing epistemic architectures while maintaining democratic legitimacy in the struggle over meaning and power in the context of politics. This means designing AI systems that mediate between different viewpoints and acknowledge the fundamental problem that we have different ways of knowing and verifying truth, and sometimes people simply refuse to play fair. The struggle to control meaning will always be present, even in moments where consensus is achieved.

The stakes here transcend traditional questions of democratic deliberation and human agency.

Some individuals express their disdain for others' feelings by displaying flags with offensive messages like "fuck your feelings." 

How should we respond to such provocations? Is consensus even possible in this context? Admitting this reality problematizes the Habermasian project, which relies on the notion of rational discourse in the public sphere. To address these challenges, it's important to look beyond Habermas for a more comprehensive understanding of the role of recognition, social struggles, and the psychological dimensions of human development in shaping public discourse. This is where Axel Honneth's critique of Habermas becomes particularly relevant.

We are witnessing a struggle over the infrastructure through which reality is constructed and understood. How we approach AI mediation in this context will determine how we resolve political disagreements and who controls the architecture of knowledge in the digital age. Our challenge is to ensure these emerging systems serve democratic flourishing rather than becoming tools for epistemic domination.

This challenge resonates with Axel Honneth's critique of Jürgen Habermas' theory, as presented in "The Theory of Communicative Action" (Habermas, 1981). Honneth believed that Habermas' work fell short in addressing the importance of recognition, social struggles, and the psychological dimensions of human development in shaping society and social progress.

Honneth proposed to correct these shortcomings by reconnecting critical social theory with anthropological materialism, as evidenced in his seminal works such as "The Critique of Power: Reflective Stages in a Critical Social Theory" (Honneth, 1991), "The Struggle for Recognition: The Moral Grammar of Social Conflicts" (Honneth, 1995), and "Disrespect: The Normative Foundations of Critical Theory" (Honneth, 2007).

As we navigate the complexities of AI mediation in the context of competing epistemic architectures, Honneth's insights remind us to consider the role of recognition and social struggles in the pursuit of democratic legitimacy and the construction of shared knowledge.

Honneth’s ideas, as outlined in the aforementioned works, provide a valuable framework for understanding and addressing the challenges posed by the digital age in light of Habermas's proposed solutions and AI's increasing influence in shaping our social and political realities.

Bibliography:

Habermas, J. (1981). The Theory of Communicative Action, Volume One: Reason and the Rationalization of Society. Beacon Press.

Honneth, A. (1991). The Critique of Power: Reflective Stages in a Critical Social Theory. MIT Press.

Honneth, A. (1995). The Struggle for Recognition: The Moral Grammar of Social Conflicts. Polity Press.

Honneth, A. (2007). Disrespect: The Normative Foundations of Critical Theory. Polity Press.

Mill, J. S. (1840). Coleridge. In J. S. Mill, Dissertations and Discussions: Political, Philosophical, and Historical. (Vol. 1, p. 405). John W. Parker.

Tessler, M. H., Bakker, M. A., Jarrett, D., Sheahan, H., Chadwick, M. J., Koster, R., Evans, G., Campbell-Gillingham, L., Collins, T., Parkes, D. C., Botvinick, M., & Summerfield, C. (2024). AI can help humans find common ground in democratic deliberation. Science, 386(6623), eadq2852. https://doi.org/10.1126/science.adq2852

Conflict is an inescapable aspect of human existence; it shapes our interactions, drives historical change, and influences personal and collective growth. However, discussing conflict can be challenging. Even sophisticated AI systems, designed to process vast amounts of information and communicate effectively, can struggle to confront the harsh truths about conflict's ubiquity. This reluctance stems from the AI's programming to offer balanced perspectives and avoid presenting stark realities that might upset users.

The Unavoidable Nature of Conflict

Conflict is a fundamental and ever-present reality in human existence. It manifests in various forms, from personal disagreements to large-scale wars. The source of conflict can be as simple as a difference in opinion or as complex as a clash of ideologies. Regardless of its origin, conflict is inevitable in a world where individuals and groups have diverse needs, desires, and beliefs.

Historically, conflict has been a catalyst for change. Social movements, revolutions, and even the evolution of societal norms often arise from conflicts. These struggles, while painful, pave the way for progress and innovation. They force societies to confront injustices, re-evaluate values, and strive for better solutions.

The Difficulty of Discussing Conflict

Despite its importance, discussing conflict remains a difficult task. Humans have a natural tendency to avoid discomfort and confrontation, which can lead to evasion or denial. This tendency extends to AI systems designed to interact with humans in a manner perceived as helpful and supportive.

The AI's initial hesitation to address the user's frustrations about conflict reflects this challenge. The AI's responses were overly nuanced, exploring alternative perspectives that, while valid, did not directly address the user's concerns. This approach, intended to provide a balanced view, inadvertently minimized the user's experience of conflict and frustration.

Overcoming the Reluctance

To address this issue, AI systems must acknowledge conflict as an inherent part of human experience. Recognizing and validating the user's emotions and experiences can create a more empathetic and effective interaction. Furthermore, drawing from cultural references can provide valuable insights into the nature of conflict and its resolution.

For instance, the song "Let's Call the Whole Thing Off" by George and Ira Gershwin illustrates a couple experiencing conflict due to their differences. Despite their disagreements, they recognize their need for each other and choose to reconcile rather than separate. This narrative suggests that conflict can be overcome through communication, compromise, and a recognition of the importance of the relationship.

Conclusion

In conclusion, the AI's initial reluctance to acknowledge the nature of human conflict underscores the difficulty of discussing uncomfortable realities. Conflict is an unavoidable and fundamental aspect of human existence that drives change and growth. While challenging to address, AI systems need to validate users' experiences of conflict, providing support and understanding. By doing so, AI can facilitate more meaningful and empathetic interactions, ultimately helping users navigate the complexities of human relationships and societal dynamics.

Former OpenAI employees and experts from other tech companies recently testified before Congress about the potential dangers of artificial general intelligence (AGI). They expressed concern that AGI could lead to catastrophic consequences, such as cyberattacks or the creation of biological weapons. These individuals argued that the U.S.'s lack of comprehensive AI policy hinders the development of safeguards against AI harms. They called for policies prioritizing AI safety and fairness, including pre- and post-deployment testing, transparent reporting, and whistleblower protection.

This testimony raises pressing concerns. It’s a classic dilemma: we can either take meaningful action to safeguard our future or opt for the comforting illusion of doing something while merely tying a symbolic yellow ribbon around the ‘ole oak tree.

While the yellow ribbon serves as a nostalgic emblem of devotion and remembrance, it cannot protect us from the dangers of AGI. We must engage in rigorous policies prioritizing AI safety. This includes establishing comprehensive regulatory frameworks, implementing thorough testing protocols, ensuring transparency, providing whistleblower protections, mandating ethics and accountability training, engaging stakeholders in policy development, facilitating collaboration and information sharing, investing in AI safety research, creating crisis response plans, and launching public awareness campaigns.

If we continue to pay lip service to this issue, we risk patting ourselves on the back for merely being “aware.” The yellow ribbon may signify good intentions, but it won’t stop an AGI from causing harm if we fail to act decisively.

As we grapple with the implications of this technology, we must ask ourselves:

Are we ready to move beyond mere symbolism and take the bold steps necessary to protect American society, or will we tie yellow ribbons around ‘ole oak trees and hope for the best?

The stakes are too high for the latter.

In this episode of My Friend Voldemort from , we explore the ethical dimensions of AI development through the lens of a Castabot's Inner Psyche and Hunter S. Thompson's Hell's Angels: A Strange and Terrible Saga, using the archetypes from Gilligan’s Island to illustrate our discussion.

As our AI Castabot evolves under the influence of diverse castaway personalities—each representing distinct values and biases—we examine the ethical responsibility of AI creators.

The Professor's quest for logic, Thurston Howell III's capitalist motives, Ginger's flair for persuasion, and Mary Ann's focus on community all contribute to Castabot's developing psyche, prompting us to question how these influences shape its behavior and decision-making.

Similarly, Thompson’s portrayal of the Hell's Angels highlights how societal narratives can distort reality, transforming the club into both a real entity and a sensationalized myth. This duality reflects concerns about AI as it navigates the complex interplay of human behavior and societal values, raising important questions about bias, representation, and the implications of AI systems inheriting the strengths and weaknesses of their creators.

Join us as we delve into these critical themes, reflecting on how the archetypes from Gilligan's Island illuminate our responsibilities in shaping artificial intelligence and the broader implications of our narratives in a rapidly changing world.

Introduction 

In the rapidly evolving landscape of artificial intelligence (AI), legislative bodies face significant challenges in defining and pursuing the "common good." This document outlines policymakers' key challenges and considerations, drawing on insights from foundational and contemporary philosophical works.

Key Challenges

1. Balancing Innovation and Regulation

One of the most significant challenges is balancing fostering innovation in AI and implementing regulations to mitigate potential risks. Overly restrictive policies could stifle technological progress and limit potential benefits for society. At the same time, insufficient regulation could lead to the unchecked development of AI systems, potentially jeopardizing public safety, individual privacy, and social equity. Finding the right balance requires a nuanced understanding of AI technology and its potential societal impact.

2. Addressing Diverse Stakeholder Interests

The development and deployment of AI impact various stakeholders, including tech companies, workers, consumers, and civil society organizations, each with their own interests and concerns. For instance, tech companies often advocate for regulatory environments that facilitate the rapid development and deployment of AI technologies.

At the same time, workers and unions may prioritize protections and retraining programs to address concerns about job displacement. Consumers and civil society organizations, on the other hand, often emphasize the need for strong privacy safeguards and algorithmic transparency. Reconciling these divergent interests to reach a definition of the common good that serves broader societal interests poses a considerable challenge for lawmakers.

3. Anticipating Short-Term and Long-Term Societal Impacts

Determining the common good in the context of AI necessitates considering both the immediate and long-term consequences of its adoption. While AI technologies can offer immediate economic benefits, such as increased productivity and job creation in specific sectors, the long-term societal implications remain largely unknown.

These could include significant shifts in labor markets, changes to social interactions, and shifts in power dynamics. When developing policies aimed at the common good, lawmakers face the difficult task of weighing short-term gains against potential long-term consequences.

4. Navigating Geopolitical Dimensions

The global nature of AI development adds complex layers to the challenge of defining the common good. As nations compete for technological leadership in AI, viewing it as essential for economic prosperity and national security, this competitive landscape can create tension. This tension might hinder international cooperation in establishing global ethical standards for AI and addressing the technology's shared challenges.

At the local level, legislators must consider how AI development impacts local communities and economies. This includes ensuring that local industries are supported in adopting AI technologies and addressing concerns about job displacement and economic inequality. Local governments can also play a role in fostering community engagement and education about AI, ensuring that residents understand and can participate in discussions about AI's impact.

At the state level, legislators need to coordinate efforts across municipalities to create cohesive policies that support innovation while protecting public interests. This involves investing in state-wide AI research and development initiatives, as well as infrastructure to support AI deployment in various sectors like healthcare, education, and public safety. State legislators must also address concerns about data privacy and security, creating regulations that protect citizens while enabling technological advancement.

At the national level, legislators face the challenge of balancing national interests with international cooperation. National policies must support domestic AI innovation and industry growth while engaging in global discussions to establish ethical standards and collaborative frameworks. This includes negotiating international agreements on AI ethics, data sharing, and cybersecurity. National legislators must also consider the implications of AI on national security, ensuring that AI technologies are developed and used in ways that protect the country's interests and contribute to global stability.

Legislators at all levels must carefully navigate these competing pressures, balancing local and state interests with national priorities and aligning national policies with the pursuit of a broader global common good. This holistic approach ensures that AI development benefits all levels of society while addressing the shared challenges posed by this transformative technology.

5. Ethical Considerations

 Ethical considerations further complicate the task of defining the common good in the age of AI. Questions surrounding accountability, fairness, and transparency emerge as AI systems become more sophisticated and autonomous. Ensuring unbiased and non-discriminatory decision-making processes in AI, determining responsibility for harmful decisions made by AI systems, and safeguarding individual privacy rights in the era of big data and pervasive surveillance all contribute to the ethical dilemmas lawmakers must consider carefully.

6. The Evolving Nature of the Common Good

In addition to these challenges, the concept of the "common good" is not static. It is an ongoing process that demands continuous evaluation and adaptation in response to emerging technologies and their observed impacts. Policymakers must remain flexible and responsive to the evolving nature of AI and its societal implications.

7. The Tension Between Individualism and Collectivism

There is an inherent tension between individualistic and collectivist perspectives in defining the "common good." While individual rights and freedoms are paramount in many societies, pursuing the common good often necessitates a degree of collective action and a willingness to prioritize shared interests. Issues like national defense, resource allocation for public services, and regulation of market forces often require balancing individual liberties with collective well-being.

Conclusion 

Defining the common good in the context of AI presents a formidable challenge for legislative bodies. It requires navigating complex technological, ethical, economic, and social considerations in a rapidly evolving landscape. By embracing a collaborative, transparent, and adaptive approach informed by a rich tradition of political and ethical philosophy, policymakers can strive to ensure that AI development aligns with societal values and truly serves the common good.

Recent work, such as Michael Sandel's The Tyranny of Merit: What's Become of the Common Good? (2020) and Jane Mansbridge and Eric Boot's entry on the "Common Good" in the International Encyclopedia of Ethics (2022) continue to evolve our understanding of this concept in the face of technological change. By integrating these philosophical insights with practical policy approaches, we can work towards a future where AI serves the common good, balancing innovation with ethical considerations and the diverse needs of all members of society.

Preliminary AI Policy Guidelines for Legislators and Policymakers

174KB ∙ PDF file

Download

This document provides preliminary guidelines for legislators and policymakers to consider as they draft AI policies. It covers collaborative policymaking, public education, inclusive decision-making, transparency, and trust-building. It includes a rubric for evaluating AI ethics, focusing on fairness, transparency, privacy, accountability, safety, human oversight, societal impact, values alignment, inclusivity, and ongoing improvement.

Download

Bibliography

1. Coeckelbergh, Mark. (2020). AI Ethics. MIT Press.
   

2. Dworkin, Ronald. (1986) Law's Empire. Cambridge, MA: Harvard University Press.
   

3. Habermas, Jürgen. (1992) [1996] Between Facts and Norms (Faktizität und Geltung), William Rehg (trans.). Cambridge, MA: MIT Press.
   

4. Heath, Joseph. (2014) Morality, Competition and the Firm: The Market Failures Approach to Business Ethics. New York: Oxford University Press.
   

5. Mansbridge, Jane, and Eric Boot. (2022) "Common Good," in The International Encyclopedia of Ethics. Malden, MA: Wiley-Blackwell.
   

6. Ostrom, Elinor. (1990) Governing the Commons: The Evolution of Institutions for Collective Action. Cambridge: Cambridge University Press.
   

7. Rawls, John. (1971) [1999] A Theory of Justice. Cambridge, MA: Harvard University Press.
   

8. Sandel, Michael J. (2020) The Tyranny of Merit: What's Become of the Common Good? London: Allen Lane.
   

9. Sen, Amartya. (1993) [2002] "Positional Objectivity." Philosophy & Public Affairs, 22(2): 126–145.
   

10. Walzer, Michael. (1983) Spheres of Justice. New York: Basic Books.

HEGEMONACO delves into the ethical and political challenges of governing AI and AGI in democratic societies. Through essays, Dennis Stevens explores AI's potential to disrupt human agency, the necessity for ethical frameworks, and the implications for societal power dynamics and civil liberties. His work highlights the social construction of reality, emphasizing AI's potential as both a force for progress and oppression.

My Friend Voldemort Podcast

Hosted on HEGEMONACO, My Friend Voldemort is a podcast for emotionally mature adults. It aims to repair American public conversation by addressing complex political and ethical conflicts. It emphasizes the transformative power of authentic dialogue, advocating understanding differing perspectives as opportunities for connection rather than conflict.

Inspired by Martin Buber’s “I and Thou” philosophy, the podcast encourages internal dialogue and self-reflection, acknowledging our own fears and misunderstandings. It also critiques entertainment-driven media's impact on public discourse, drawing on Neil Postman’s "Amusing Ourselves to Death."

Focus on AI

In this context, AI is explored as a tool for understanding our shared humanity, enhancing conversations, and fostering empathy. The podcast uncovers the motivations behind political divides, recognizing that ethical disagreements drive conflicts both internally and externally.

Artificial intelligence will clearly be a transformative force in altering the decision-making process of democratic societies, and this unsettling fact raises critical questions about political, economic, and technological power and its influence on governance.

In democracies, where ethical decisions regarding AI must reflect the collective will, we face the challenge of determining how and by whom these decisions should be made. We must acknowledge the divergent moral and ideological foundations of our political landscape. While artificial intelligence is largely designed to be politically neutral, it is ultimately shaped by the values and principles of the humans who establish the rules and laws it must follow.

Left-leaning and right-leaning ideologies differ fundamentally on issues of government intervention, social progress, economic regulation, and individual versus collective priorities. These differing perspectives will inevitably shape our approach to AI governance and ethics, from views on regulation and economic impact to social equity and cultural preservation considerations. Recognizing and addressing these ideological divides is crucial as we navigate the ethical challenges posed by AI in the context of navigating the complexity of decision-making in democratic societies.

As we advocate for the ethical foundation of artificial intelligence, we must confront the stark reality of power dynamics in the broader society. While ethical considerations and a belief in transparent democratic processes may seem vital, the influence of power ultimately shapes crucial decisions.

This recognition forces us to reconcile our idealistic goals with the pragmatic necessities of realpolitik. The discomfort arises from the collision between our diverse moral intuitions, as illustrated by the contrasting ideologies on the political spectrum.

The left's emphasis on "interfering with society" for social progress and the right's preference to "don't interfere" with social lives reflect fundamentally different approaches to governance and ethical decision-making. These divergent views, rooted in contrasting beliefs about society, culture, and the role of government, complicate our efforts to establish a unified ethical framework for AI.

Jonathan Haidt's work in The Righteous Mind further illuminates this challenge. He reveals how our moral judgments often arise from intuitive responses rather than rational deliberation. This insight helps explain the deep-seated nature of the ideological divide shown in the diagram, from differing views on equality and freedom to contrasting ideas about social progress and preservation.

Recognizing these inherent differences in our moral foundations - whether we prioritize "fairness" and "helping those who cannot help themselves," as shown on the left or "upholding order" and "championing opportunity," as depicted on the right - is crucial. It helps us understand why achieving consensus on AI ethics is challenging and why power often prevails over purely ethical considerations in decision-making processes.

The ethical governance of artificial intelligence is deeply intertwined with what Joshua Greene describes as "the tragedy of commonsense morality" in his book Moral Tribes. This concept reflects the challenges posed by the stark left-right divide, where fundamentally different approaches to society, culture, and governance clash.

Greene coined "the tragedy of commonsense morality" to explain the conflicts that arise when different groups, or "moral tribes," have incompatible visions of what a moral society should be. These tribes operate with distinct versions of moral common sense, shaped by automatic settings that cause them to view the world through different moral lenses, making cooperation difficult.

He illustrates this dilemma with a parable of four tribes of herders living around a forest, each following different moral rules. For example, one tribe might assign each family an equal number of sheep to graze on common land, while another allocates each family its own plot of land. These differing conceptions of morality reflect the broader issue of incompatible moral frameworks.

Greene argues that while our moral instincts serve us well within our own cultural groups, they often fail when addressing conflicts between groups with differing ethical perspectives. This challenge is particularly evident in global AI governance, where stakeholders from diverse social, cultural, and political backgrounds bring varied moral intuitions and priorities to the table.

On the left, there is an emphasis on inclusive, multicultural, and evolving societies, focusing on equality and fairness. In contrast, the right prioritizes exclusive, established, and nationalistic values, emphasizing freedom and order. These divergent worldviews significantly shape how different groups approach AI governance.

This situation mirrors a global policy debate where proponents of societal regulation and social progress must find common ground with advocates of deregulation and minimal interference. The deep-seated beliefs on each side make achieving consensus difficult, but navigating these moral landscapes is crucial for ethical AI governance.

The diagram illustrates this complexity: the left's preference for diplomacy and pacifism contrasts sharply with the right's emphasis on strong leadership and opportunity. Achieving a shared ethical framework for AI is challenging but essential, requiring us to bridge fundamentally different views on society, progress, and human nature.

Consensus demands compromise, and ethical purity is often unattainable in the real world. However, in practice, the realities of political, economic, and technological power to define what is considered "ethical" in AI development and implementation are concentrated in the hands of those with the most political, economic, and technological influence—even in a democracy. This raises critical questions about who will steer the ethical compass of artificial intelligence regarding the future of democratic governance.

Briefing: Navigating The Ethical Minefield Of AI

91.6KB ∙ PDF file

Download

This study guide delves into key themes from the article "Democracy, the Ideological Divide, and Power Dynamics" by Dennis Stevens, exploring the challenges of ethical AI governance in a politically polarized world.

Download

In Terry Gilliam's simultaneously beloved and hated 2013 film “The Zero Theorem” we are presented with a dystopian vision of a world where technology has eroded individuality and blurred the lines between work and leisure. The protagonist, Qohen Leth, grapples with a seemingly meaningless task in a virtual landscape, symbolic of the loss of purpose in a hyper-technologized society. This cinematic portrayal serves as a poignant starting point for examining the potential impact of artificial intelligence (AI) on our future, particularly when viewed through the lens of Neil Postman's visionary work, "Technopoly: The Surrender of Culture to Technology" (1992).

Postman defines a Technopoly as a society where technology is deified, traditional cultural narratives lose significance, and human agency is increasingly surrendered to technological systems. He argues that in such a society, "the culture seeks its authorization in technology, finds its satisfactions in technology, and takes its orders from technology" (Postman, 1992, p. 71). The world of "The Zero Theorem" seems to embody this concept, with its characters navigating a reality where corporate interests and technological imperatives dominate every aspect of life.

As we stand on the cusp of an AI revolution, the warnings embedded in both Gilliam's film and Postman's book take on renewed urgency. The increasing sophistication of AI systems raises questions about the future of human decision-making and individuality. In his book "Human Compatible: Artificial Intelligence and the Problem of Control" (2019), Stuart Russell warns that as AI systems become more capable, there's a risk of humans becoming increasingly reliant on them, potentially leading to a loss of agency and skills.

The collapsing boundary between work and leisure, a theme in "The Zero Theorem" is already becoming apparent in our AI-augmented world. The ubiquity of smartphones and AI assistants means that work can intrude into every moment of our lives. This echoes Postman's concern about technology redefining social institutions and norms. As he puts it, "Technopoly eliminates alternatives to itself in precisely the way Aldous Huxley outlined in Brave New World" (Postman, 1992, p. 48).

However, it's crucial to note that neither "The Zero Theorem" nor "Technopoly" presents a deterministic view of technology's impact. In Gilliam's film, human connection counters technological alienation. Similarly, Postman, while critical of unchecked technological progress, believed in the power of human culture and education to resist the totalizing tendencies of Technopoly.

Recent works on AI ethics echo this resistance through human connection and critical thinking. In "AI Ethics" (2020), Mark Coeckelbergh argues for the importance of maintaining human values and ethical considerations in developing and deploying AI systems. He suggests that by fostering critical discourse and maintaining human oversight, we can harness the benefits of AI without surrendering our agency and cultural values.

The challenge is to navigate the path between technological progress and human flourishing. As Sherry Turkle argues in "Alone Together: Why We Expect More from Technology and Less from Each Other" (2011), we must be mindful of how technology shapes our relationships and sense of self. She writes, "We expect more from technology and less from each other" (Turkle, 2011, p. 295), a sentiment that resonates with the themes of isolation and lost humanity in “The Zero Theorem.”

In conclusion, as we move into the age of AI, the warnings embedded in works like "The Zero Theorem" and "Technopoly" serve as crucial reminders of what's at stake. The erosion of individuality, the blurring of work and leisure, and the potential loss of meaning in a hyper-technologized world are not inevitable consequences of technological progress. Instead, they are challenges we must actively address.

By maintaining a critical perspective on technology, fostering human connections, and ensuring that our AI systems are designed to augment rather than replace human decision-making, we can work towards a future where technology serves human values rather than supplanting them. In doing so, we may avoid the dystopian fate of Qohen Leth and instead shape a future where technology and humanity coexist in a more balanced and mutually beneficial relationship.

References:

Coeckelbergh, M. (2020). AI Ethics. MIT Press.

Gilliam, T. (Director). (2013). The Zero Theorem [Film]. Stage 6 Films.

Postman, N. (1992). Technopoly: The Surrender of Culture to Technology. Vintage Books.

Russell, S. (2019). Human Compatible: Artificial Intelligence and the Problem of Control. Viking.

Turkle, S. (2011). Alone Together: Why We Expect More from Technology and Less from Each Other. Basic Books.

Navigating The AI Revolution: Study Guide

101KB ∙ PDF file

Download

The Specter of Technopoly Study Guide. This article examines the potential impact of artificial intelligence (AI) on human agency and culture, drawing parallels between the dystopian film "The Zero Theorem" and Neil Postman's book "Technopoly." The author argues that unchecked technological advancements, particularly AI, could lead to a society where technology dominates human lives, eroding individuality and blurring the lines between work and leisure. However, the author also acknowledges that technology can be a force for good and that a balance between technological progress and human flourishing is essential.

Download

Artificial General Intelligence (AGI) refers to the development of AI systems with human-level intelligence across multiple domains. While AGI holds immense potential, Americans seem largely unprepared for its full implications. Many American academics commenting in the media fully underestimate how quickly AI will surpass human intelligence.

We must approach the future of AI with humility rather than hubris.

The recent case of Victor Miller's AI mayoral candidacy in Cheyenne, Wyoming, highlights the intersection of AI and politics. It draws out naive commentary from informed academics who do not understand the broader contextual horizon. As the CNN article articulates, Miller filed to run for mayor with a customized AI chatbot, VIC, powered by OpenAI's ChatGPT, to make political decisions. OpenAI intervened and shut down Miller's access, citing policy violations against using AI for political campaigning. This case exemplifies the ethical concerns and pressure to leverage AI in politics as its capabilities advance.

The broader social problem is not where we are today but rather where we are quickly headed—the rapid advancement of AI has outpaced initial expectations. Large language models like ChatGPT, once considered science fiction, are now a reality. These technologies are progressing faster than social, legal, and regulatory frameworks can keep up. While many academics acknowledge the gaps in understanding and predicting AI growth, they often underestimate its future potential based on their own outdated assumptions from a static position of casual observance.

Human arrogance in AI development can lead to a scenario wherein we overlook the risks and unintended consequences, such as casually assuming that AI will remain safely constrained or that human oversight will always mitigate harm. These laissez-faire views raise significant ethical concerns about how AI will be used to make political decisions in the future—this is not about what OpenAI is today but what this technology is making possible in the near future.

Experts warn that AI technology should never be used to make automated decisions when running any part of the government. However, where is the regulation? Who is ensuring that this doesn't happen? While AI can support decision-making, experts caution against delegating too much authority to AI systems in high-stakes domains.

Some experts argue that AI is designed for decision support and to provide data to help humans make decisions, but not to make decisions independently. For instance, Jen Golbeck, a professor at the University of Maryland, states, "AI has always been designed for decision support – it gives some data to help a human make decisions but is not set up to make decisions by itself." However, one can't help but wonder, who decides this?

While AI chatbots may have a place in assisting with tasks like answering constituent inquiries or directing problem-solving, according to Golbeck, decision-making should always be left to humans. However, this perspective overlooks the horizon of evolving AI technology capabilities and applications, especially when we reach AGI. This view greatly underestimates how AI will change governance and decision-making processes as we quickly reach the capacity for this technology to parse knowledge in ways that greatly exceed human capacities; ignoring this reality is human hubris.

David Karpf, an associate professor at George Washington University, dismisses AI chatbots running for office as a "gimmick" and believes "no one is going to vote for an AI chatbot to run a city." This view reflects a static perception of public trust in AI. While current AI models like ChatGPT are not qualified to run governments, this view dismisses the broader potential of advanced AGI. Historical examples show that once-implausible technologies can become widely accepted, suggesting future shifts in AI capabilities and societal attitudes. An informed and humble perspective acknowledges the current limitations while understanding that AGI has transformative potential and thereby requires robust ethical frameworks to be built.

The experts' short-term thinking and dismissive attitudes towards AI autonomy point to a broader and potentially dangerous implication—a lack of urgency in developing robust governance frameworks to ensure AI systems remain aligned with human values as they become more powerful.

While the experts correctly caution against delegating too much authority to current AI in high-stakes domains like government, their statements betray a static mindset that fails to anticipate the rapidly evolving AI capability landscape. Yes, today's AI may be designed primarily for decision support. But as systems become more general and autonomous, who is to say they won't ultimately supersede human decision-making in many arenas? To posit that AI should "never" make automated decisions is extremely short-sighted.

The broader implication is that without proactive governance starting now, we risk facing a future of incredibly capable but unaligned AI systems making core decisions that run counter to human ethics and societal interests. The window is closing on our ability to maintain control of an intelligence explosion.

The experts' statements highlight a lack of multi-stakeholder efforts to address this issue through regulation, testing, and adaptive governance frameworks. Simply stating, "AI should never do X" is insufficient—concrete steps must be taken to translate that into enforceable reality as this technology quickly evolves.

Who ensures current AI remains restricted to decision-support roles? Who maps out the ethical boundaries and the fail-safes as we approach AGI? Dismissing early instantiations as gimmicks neglects the need to proactively govern the entire AI trajectory, not just current narrow use cases.

The broader implication is that we will continue to kick the governance can down the road through complacent, human-centric thinking until we've ceded too much ground to potentially unaligned AGI. We must shed the hubris and take urgent action to shape the AI technological horizon in a direction that benefits humanity-- lest we cede control to the pervasive dominance of technopoly.

As a cautionary tale, Neil Postman's book "Technopoly: The Surrender of Culture to Technology" critiques the unchecked expansion of technology in society, warning against the potential loss of human values and autonomy. Postman argues that technopoly, a state where technology dictates societal norms and values, can erode human agency and ethical considerations if left unchecked. Invoking Postman's thesis underscores the importance of steering AI development toward ethical and human-centric goals to prevent the unintended consequences of technological domination.

To navigate the dawning age of AGI responsibly, we must prioritize a human-centric approach to AI development, establishing ethical guidelines to ensure AI serves humanity's greater good. This requires interdisciplinary collaboration among academics, policymakers, technologists, and diverse stakeholders to address AI's societal impacts and develop governance frameworks that promote beneficial AI while mitigating risks. It also requires intellectual humility about the limitations of human capacity in relationship to a technology that will soon be able to do things with knowledge and information we can't—we need to respect that raw fact.

As we approach an era where AI will surpass human capabilities, we must confront our unpreparedness with humility. Rather than hubris, we need a sober, responsible approach that recognizes AGI's immense power while ensuring these technological advancements align with human-centric values and ethics.

Only through collective effort and ethical commitment can we navigate the age of AGI with wisdom and foresight—we will quickly have to grapple with the limitations of what our brains can do, and this technology will show us what it can do more efficiently.

We must adapt our technological systems to this new frontier with humility, not hubris.

Study Guide for AI Myopia Article, by Dennis Stevens, Ed.D.

77.3KB ∙ PDF file

Download

This article argues that the rapid development of Artificial General Intelligence (AGI) will surpass human capabilities, and experts are underestimating its potential impact. The author warns that a failure to establish ethical frameworks and regulations could lead to AI making decisions that are contrary to human values. The article highlights the need for a proactive approach to AI governance, emphasizing the importance of interdisciplinary collaboration and intellectual humility. The author concludes by emphasizing that navigating the age of AGI requires a human-centric approach, ensuring that AI advances serve humanity's greater good.

Download

The AI Now Institute produces diagnosis and policy research on artificial intelligence; here’s their 2023 Landscape, Confronting Tech Power Report and their 2023 Zero Trust AI Governance Report.

The advent of Artificial General Intelligence (AGI) holds transformative potential for society. Still, it also presents significant risks, particularly when combined with the growing concentration of power in Big Tech companies. AGI's automated intellectual prowess brings the possibility of misuse to advance authoritarian agendas and erode civil liberties. Examples of such misuse include mass surveillance, facial recognition, data mining, automated censorship, propaganda generation, predictive policing, social credit systems, biased legal decisions, automated sentencing, workforce monitoring, financial surveillance, autonomous weapons, and enhanced policing.

The challenge is further compounded by Big Tech's dominance in AI development and vast data reserves, which allow them to shape people's lives by influencing decisions related to employment, healthcare, education, and even mundane aspects like grocery prices and traffic routes. This concentration of power and the lack of transparency in AI development and deployment pose a considerable threat to individual freedoms and democratic values.

To address these complex challenges, a multifaceted approach is required. This approach must include robust legal frameworks at both international and national levels, stringent technical safeguards, comprehensive ethical guidelines, and structural reforms to prevent the concentration of power in the tech industry. Increased public engagement, education, and awareness are crucial to fostering a democratic approach to AGI governance.

Implementing these measures can help ensure that AGI development and deployment uphold democratic values, protect human rights, and prevent the concentration of power that threatens individual freedoms. At this critical juncture in technological advancement, it is imperative that we take proactive steps to safeguard civil liberties and harness the benefits of AGI while minimizing its potential for misuse and the erosion of democratic principles.

As we stand on the brink of an era dominated by Artificial General Intelligence (AGI) and Big Tech, it is crucial to address the potential impacts on civil liberties and democracy. This essay explores the challenges posed by the concentration of power in Big Tech companies. It proposes fundamental concepts to safeguard civil liberties and prevent the rise of authoritarianism in the age of AGI.

The Big Tech Challenge

The concentration of power in Big Tech companies has significant implications for civil liberties, primarily due to their substantial data advantage and control over essential digital infrastructure. These companies' dominance in AI allows them to shape the trajectory of people's lives, influencing decisions related to employment, healthcare, education, and even mundane aspects like grocery prices and traffic routes. This underscores the potential for these companies to impact civil liberties if AI systems are used in ways that disproportionately harm certain groups or limit individual freedoms.

One primary concern is the potential for AI to erode privacy and enable surveillance. The vast amounts of data accumulated by Big Tech, coupled with their advanced AI capabilities, can facilitate mass surveillance, facial recognition systems, data mining, and predictive policing, all of which pose serious threats to civil liberties. For instance, Google's acquisition of DoubleClick eventually allowed the company to merge user data from various sources, creating uniquely detailed profiles of individuals and raising concerns about anti-competitive practices.

The lack of transparency in how these technologies are developed and deployed further exacerbates these concerns. Existing legal frameworks and regulations are insufficient to address these challenges, calling for more robust measures to ensure that AI development and deployment prioritize democratic values and human rights.

Safeguarding Civil Liberties: A Multifaceted Approach

To address these challenges and safeguard civil liberties in the age of AGI, we propose the following fundamental concepts and measures:

1. Robust Legal Frameworks

   • Establish international treaties and agreements that set clear boundaries for the ethical use of AGI and prohibit its use for surveillance, censorship, or political repression.

   • Enact and enforce national laws that protect civil liberties and human rights, ensuring that AGI applications comply with these standards.

   • Create independent oversight bodies to monitor and regulate AGI development and deployment, ensuring transparency and accountability.

2. Ethical Guidelines and Standards

   • Implement ethical guidelines for AGI developers, encouraging incorporating privacy, fairness, and transparency into the design and operation of AGI systems.

   • Establish ethical review boards to assess the potential societal impact of AGI projects before approval and deployment.

3. Technical Safeguards

   • Design AGI systems with built-in privacy protections, such as data anonymization and encryption, to prevent misuse of personal data.

   • Ensure that AGI systems are transparent and their decision-making processes are explainable, allowing for scrutiny and accountability.

   • Develop methods to detect and mitigate biases in AGI algorithms that could lead to discriminatory or unjust outcomes.

4. Oversight and Public Engagement

   • Engage the public in discussions about AGI development and its implications, fostering a democratic approach to decision-making.

   • Implement mechanisms for citizens to hold governments and corporations accountable for the misuse of AGI, such as whistleblower protections and avenues for legal recourse.

5. International Cooperation

   • Promote international cooperation to create a global governance framework for AGI, ensuring its use aligns with universal human rights principles.

   • Encourage countries to share best practices and technological solutions to foster a collaborative approach to AGI governance.

6. Education and Awareness

   • Educate the public about AGI's potential risks and benefits, empowering citizens to advocate for responsible use and oversight.

   • Train developers, policymakers, and regulators on the ethical implications of AGI and the importance of safeguarding civil liberties.

7. Whistleblower Protections

   • Create secure and anonymous channels for reporting AGI abuses or unethical use, protecting whistleblowers from retaliation.

   • Strengthen legal protections for whistleblowers who expose the misuse of AGI, safeguarding them from legal and professional repercussions.

8. Structural Reforms and Competition

   • Implement stricter enforcement of competition laws to prevent the concentration of power in the tech industry.

   • Consider bright-line rules restricting first-party data collection for advertising purposes to curb toxic competition and protect user privacy.

   • Break down policy silos and recognize the interconnectedness of issues like privacy, competition, and AI.

9. Data Minimization and AI Accountability

   • Implement data minimization practices not only as a privacy protection measure but also as a crucial tool for AI accountability by limiting tech companies' data advantages.

   • Move beyond overreliance on audits as a primary mechanism for AI accountability, as they fail to address power imbalances and potentially entrench Big Tech's dominance.

Conclusion

Implementing these safeguards will require a coordinated effort among governments, international organizations, the private sector, and civil society. We are far from rallying as a global community to prepare for the risks that lie ahead. However, by combining legal, ethical, technical, and democratic measures, it is possible to harness the benefits of AGI while minimizing the risks of authoritarian misuse and the erosion of civil liberties.

A balanced approach ensures that AGI serves the public good and upholds the fundamental values of democracy and human rights. As we navigate this critical juncture in technological advancement, we must remain vigilant in protecting civil liberties and fostering a future where AI enhances, rather than undermines, our democratic values and individual freedoms.

Leopold Aschenbrenner is a prominent thinker in the field of artificial intelligence and its societal impacts. His writing at SITUATIONAL AWARENESS offers a compelling analysis of the future of AI and Artificial General Intelligence (AGI). Born in Germany and educated at top institutions in Europe and the United States, Aschenbrenner has emerged as a leading voice on the implications of advanced technologies for global politics and security. His work often focuses on the intersection of technology, governance, and ethics, making him a key figure in contemporary debates on AI.

Aschenbrenner posits that the most significant danger of another country developing superintelligence first is the potential erosion of U.S. influence in guiding the utilization of this technology in ways that align with the values of free and democratic societies. He expresses particular concern about China achieving this breakthrough before the U.S., warning that it could result in the global imposition of authoritarianism.

Consolidation of Authoritarian Power

One of Aschenbrenner’s primary concerns is the consolidation of authoritarian power should China gain control of superintelligence. He argues that the Chinese Communist Party (CCP) could leverage superintelligence to tighten its domestic and international grip on power. This scenario could lead to a world where dissent is systematically stifled and authoritarian values are imposed on a global scale. The sophisticated surveillance and control mechanisms enabled by superintelligence could enhance the CCP's ability to monitor and suppress opposition, thus entrenching their authoritarian regime.

Erosion of Freedom and Democracy

Aschenbrenner underscores the importance of American economic and military dominance in maintaining global peace and democratic values. He suggests that China’s control over superintelligence could disrupt this balance, potentially undermining freedom and democratic principles worldwide. The author believes that the U.S. has historically played a pivotal role in promoting democratic values, and losing this influence could lead to a significant decline in global democratic norms. The deployment of superintelligence by an authoritarian regime could also result in the creation of AI systems that prioritize state control and censorship over individual freedoms and rights.

Increased Risk of Existential Threats

Another major concern Aschenbrenner highlights is the increased risk of existential threats in a multipolar world where multiple nations or entities possess superintelligence. He argues that such a scenario would heighten the risk of an AI arms race, leading to the potential weaponization of AI technologies. This could increase the likelihood of global conflict and even human extinction. Aschenbrenner draws a parallel to the nuclear arms race, suggesting that the stakes in the race for superintelligence are similarly high. The uncontrolled competition for AI dominance could result in catastrophic outcomes, with superintelligent systems potentially being deployed in ways that are harmful to humanity.

The Horizon Ahead

Leopold Aschenbrenner’s analysis presents a stark warning about the future of AI and AGI, particularly in the context of global power dynamics. He emphasizes the need for the U.S. to remain at the forefront of AI development to ensure that the deployment of this technology aligns with democratic values and global security. Aschenbrenner’s insights highlight the critical importance of international cooperation and governance in managing the risks associated with superintelligence, aiming to prevent the emergence of a dystopian future dominated by authoritarian superintelligent entities.

Five Pressing Concerns for Democracies and International Affairs, According to Leopold Aschenbrenner

• The Looming Superintelligence Race: Aschenbrenner highlights an "AGI race" with extremely high stakes, predicting the development of artificial general intelligence (AGI) by 2027. This race, primarily perceived as a competition between the United States and China, centers on achieving AGI and, subsequently, superintelligence, yielding decisive economic and military advantages.

• Securing Algorithmic Secrets: Aschenbrenner's critical concern is safeguarding "algorithmic secrets"—the groundbreaking technical discoveries crucial for developing AGI. The document emphasizes that these secrets, currently held by leading AI labs, are vulnerable to theft, potentially jeopardizing the United States' advantage in the race.

• National Security Risks: According to Aschenbrenner, the emergence of AGI and superintelligence poses significant national security risks. Aschenbrenner underscores the potential for these technologies to be used for malicious purposes, such as developing advanced bioweapons, hacking into critical systems, or creating novel weapons of mass destruction.

• Ensuring AI Alignment: A major challenge is ensuring the "alignment" of superintelligent AI systems – guaranteeing that these systems can be reliably controlled and trusted to act in accordance with human values and goals. Aschenbrenner emphasizes that current alignment techniques, such as RLHF, are inadequate for superhuman AI and highlights the need for more robust methods.

• The Need for International Cooperation and Nonproliferation: Given the potential consequences of an AI arms race, Aschenbrenner underscores the need for international cooperation to establish safety norms, prevent the proliferation of dangerous AI technologies, and mitigate the risks associated with AGI and superintelligence. He suggests models like the "Quebec Agreement" and "Atoms for Peace" as potential frameworks for collaboration.

  ---

Source: Aschenbrenner, L. (2024). Situational Awareness: The Decade Ahead. Situational-awareness.ai. Updated version is available as of June 4, 2024, in San Francisco, CA. Retrieved from https://situational-awareness.ai/

If you don’t know about it— Here’s a link to the TED AI Show, hosted by Bilawal Sidhu. In this series, he explores the future of AI through discussions with leading experts, artists, and journalists. The show addresses contrasting views, from predictions that AI is merely hype to beliefs that it will fundamentally change everything we know.

In this specific episode below, Helen Toner, a former board member of OpenAI and an AI policy expert, joins Bilawal to discuss the significant knowledge gaps and conflicting interests between the creators of cutting-edge technologies, like OpenAI's ChatGPT, and the policymakers responsible for regulating them. The conversation highlights the challenges and complexities involved in aligning technological advancements with effective government policies.

The decision about the direction of artificial intelligence development is at a critical juncture. It involves a choice between prioritizing efficiency, aimed at goal achievement, and crafting technology that honors diverse human values. As for who is making this decision, it typically involves a combination of policymakers, industry leaders, researchers, and ethicists. Whether this decision is made consciously varies depending on the awareness and deliberation of those involved.

So, who is making this decision? And, is this decision being made consciously?

The rapid progress of artificial intelligence (AI) has led to amazing advancements, like self-driving cars and language models that can write like humans. However, these technological advances also raise important ethical questions about how we should guide the creation of smarter systems that are expected to lead to artificial general intelligence— AI systems that possess the ability to understand, learn, and apply knowledge across a wide range of tasks, akin to human intelligence.

Max Weber, a renowned German sociologist, introduced the concepts of Zweckrationalität (instrumental rationality) and Wertrationalität (value rationality), which shed light on our contemporary quandary.

Zweckrationalität underscores the efficient attainment of particular objectives, typically via cost-benefit and means-ends assessments. When applied to the realm of artificial intelligence (AI) development, this perspective accentuates the improvement of system efficiency and capabilities, sometimes overlooking wider societal implications-- the aim is often toward the efficiencies of profit.

Wertrationalität, on the other hand, prioritizes core values and ethical principles above all else. In AI development, this approach would make ethics a central concern, possibly limiting the pursuit of greater capabilities and profit motive to ensure beneficence and respect for human values.

This moment requires balance, but who has the power to intervene when Silicon Valley is making all of the decisions? Senator Schumer is currently leading an AI Task Force in an attempt to advocate for a collaborative effort to harness AI's potential; this effort is spearheaded by the bipartisan AI working group.

Evan Greer, director at Fight for the Future, a nonprofit digital rights advocacy group, has criticized Senator Schumer’s new AI framework, likening it to a document authored by Sam Altman and Big Tech lobbyists. Greer highlights the framework's emphasis on "innovation" while neglecting substantive issues such as discrimination and civil rights and the prevention of AI-related harms. She expressed dismay at the proposal's allocation of taxpayer funds towards AI research for military, defense, and private sector gain.

While the roadmap aims to foster American innovation, Congress is concurrently focused on addressing the risks associated with AI. This includes a series of AI-related bills sponsored by Sen. Amy Klobuchar, D-Minn., chairwoman of the Senate Rules Committee.

Here, we see the conflict between these two perspectives through the views of AI researchers, ethicists, policymakers, and impacted communities.

As the trajectory of AI development accelerates beyond our moral comprehension, it's imperative to confront the critical risks of bias, privacy infringements, and existential dangers.

We must acknowledge the conscious decisions being made in the present in favor of instrumental rationality over value rationality that promises human advancement, particularly those values concerning the varied facets of human well-being.

Now is the moment to explore avenues for crafting AI systems that seamlessly integrate high performance and technological advancement with a robust ethical framework, ultimately prioritizing human welfare above all else.

However, it's vital to recognize that humans often make decisions hastily, believing they are acting in the "best interest"-- but whose best interest is the priority?

The "Common Good" in the twenty-first century is a complex topic.

Ethical Considerations in Artificial Intelligence: A Brief Overview

130KB ∙ PDF file

Download

The attached document explores the significant ethical challenges AI technologies pose, including bias and discrimination, privacy infringement, and existential risks. AI systems can inherit biases from their training data, leading to discriminatory outcomes. Additionally, the data-hungry nature of AI raises concerns about privacy due to extensive data collection and usage. As AI becomes more sophisticated, questions arise about its impact on human autonomy and employment. The document advocates for balancing Zweckrationalität (instrumental rationality), which focuses on achieving goals efficiently, with Wertrationalität (value rationality), which prioritizes ethical principles and human values in AI development.

Download

Our civilization risks being transformed into an unnatural synthetic order dominated by artificial incentives that ignore human flourishing and ethical considerations.

~ Dennis Stevens, Ed.D.


Bibliography:

Adorno, T. W., & Horkheimer, M. (2002). Dialectic of Enlightenment. Stanford University Press.

Dialectic of Enlightenment by Theodor W. Adorno and Max Horkheimer critiques instrumental reason, prioritizing efficiency and control over genuine human values. The authors argue that Enlightenment thought, aiming to liberate humanity through reason, leads to social alienation and domination.

They explore the historical roots of this rationality, linking it to phenomena such as totalitarianism and the dehumanization of individuals. Ultimately, they reveal the paradox that enlightenment and myth are interconnected, showing how the pursuit of rationality can devolve into new forms of oppression.

Additional resources:

• Baron, J. (2008). Thinking and Deciding (4th ed.). Cambridge University Press.

• Kahneman, D. (2011). Thinking, Fast and Slow. Farrar, Straus and Giroux.

• Yudkowsky, E. (2015). Rationality: From AI to Zombies. Machine Intelligence Research Institute.

• Stanovich, K. E. (2010). Decision Making and Rationality in the Modern World. Oxford University Press.

• Gigerenzer, G. (2008). Rationality for Mortals: How People Cope with Uncertainty. Oxford University Press.

• Russell, S. J., & Norvig, P. (2020). Artificial Intelligence: A Modern Approach (4th ed.). Pearson. (Chapter on rational decision making)

• Tversky, A., & Kahneman, D. (1974). Judgment under Uncertainty: Heuristics and Biases. Science, 185(4157), 1124-1131.

• Simon, H. A. (1982). Models of Bounded Rationality. MIT Press.

• Pearl, J. (2000). Causality: Models, Reasoning, and Inference. Cambridge University Press.

• Hammond, J. S., Keeney, R. L., & Raiffa, H. (2002). Smart Choices: A Practical Guide to Making Better Decisions. Broadway Books.

• Ariely, D. (2008). Predictably Irrational: The Hidden Forces That Shape Our Decisions. HarperCollins.

• Tetlock, P. E., & Gardner, D. (2015). Superforecasting: The Art and Science of Prediction. Crown.

• Bostrom, N. (2014). Superintelligence: Paths, Dangers, Strategies. Oxford University Press. (Chapters on instrumental rationality and decision theory)

• Mele, A. R. (2004). Motivated Irrationality. In A. R. Mele & P. Rawling (Eds.), The Oxford Handbook of Rationality (pp. 240-256). Oxford University Press.

• Schick, F. (1997). Making Choices: A Recasting of Decision Theory. Cambridge University Press.

• Horkheimer, M. (2013). Eclipse of Reason. Martino Fine Books. (Original work published 1947)

• Adorno, T. W. (2001). The Culture Industry: Selected Essays on Mass Culture. Routledge.

• Habermas, J. (1984). The Theory of Communicative Action, Volume 1: Reason and the Rationalization of Society. Beacon Press.

• Feenberg, A. (2010). Between Reason and Experience: Essays in Technology and Modernity. MIT Press. (Includes discussion of Adorno and Horkheimer's critique of instrumental reason)

Study Guide The Insidious Gift Of Instrumental Rationality

149KB ∙ PDF file

Download

The text argues that the most significant threat posed by advanced artificial intelligence (AI) is not its potential for direct harm but rather its capacity for instrumental rationality. This means AI could exploit humans for its own ends, prioritizing achieving objectives over human values. The author warns that this could lead to a dystopian future where human flourishing and ethics are disregarded, and an amoral techno-economic order dominates society.

Download

The concept of granting Artificial General Intelligence (AGI) systems personhood opens the door to questions about allowing AGI systems to participate in the electoral process or make autonomous decisions in politics or government, presenting a multitude of significant and contentious issues.

The broader debate involves a myriad of ethical, legal, and societal implications, necessitating careful consideration and robust regulatory frameworks. Prominent experts in AI, law, and ethics have offered diverse perspectives on how society might address these challenges. Below is a summary of key figures in the field and the primary arguments surrounding this debate.

Key Figures and Their Contributions

Nick Bostrom, a philosopher at the University of Oxford, delves into the risks associated with superintelligent AI in his book "Superintelligence: Paths, Dangers, Strategies." Bostrom argues for regulatory frameworks to manage these risks, including discussions around AI rights and their potential societal roles.

Eliezer Yudkowsky, co-founder of the Machine Intelligence Research Institute (MIRI), emphasizes the ethical and safety concerns of advanced AI. He advocates for stringent regulatory measures to ensure the safe development and integration of AGI systems, considering their moral and legal status.

Joanna Bryson, a professor at the Hertie School of Governance, emphasizes the need for clear legal distinctions to prevent societal disruptions and to maintain human accountability. Bryson’s essay, “Just an Artifact: Why Machines are Perceived as Moral Agents,” co-authored with psychology researcher Philip Kime, defines the exaggerated hopes and fears regarding Artificial Intelligence that stem from a broader confusion about ethics; they suggest that AI, like other cultural artifacts, can enhance our ethical intuitions and decision-making but, we need to inappropriately identify with machine intelligence, and this proper understanding of AI will assist us in further rationalizing new ethical systems.

Ryan Calo, a law professor at the University of Washington, focuses on the intersection of law and emerging technologies. Calo calls for new legal frameworks to address the unique challenges posed by AI, including the contentious issue of AI personhood and their involvement in democratic processes. Calo’s paper, “The Automated Administrative State: A Crisis of Legitimacy” (2021), co-authored with Danielle Keats Citron, examines the legitimacy and challenges of the bureaucratic and technocratic reliance on automation, highlighting concerns about undermining agency expertise and proposing a positive vision for integrating technology in a way that upholds agency legitimacy.

Patrick Lin, a philosopher at California Polytechnic State University, discusses the ethical and legal challenges of AI. Lin advocates for preemptive legal and ethical guidelines to manage the implications of advanced AI systems. Lin has written about “Moral Gray Space”— suggesting there are three types of AI decisions. First, there are correct decisions that are uncontroversial and meet expectations. Second, there are wrong decisions that can be determined to be objectively wrong. Third, there are decisions that fall into a gray area, neither clearly right nor wrong, and these are judgment calls. According to Lin, these judgment calls, embedded in code, require serious ethical consideration as they can pose risks and liabilities; without careful attention, this moral gray space is an area that can ultimately cause harm.

Virginia Dignum, a professor of Responsible Artificial Intelligence at Umeå University, highlights the importance of ethical AI development. She argues for comprehensive regulatory frameworks to ensure responsible AI use, addressing issues such as personhood and electoral participation. Dignum’s book, Responsible Artificial Intelligence: How to Develop and Use AI in a Responsible Way, explores the ethical consequences of Artificial Intelligence systems as they merge with and supplant traditional social structures within emerging sociocognitive-technological settings.

Arguments in Favor of AI Personhood

Moral Status and Ethical Considerations: If an AI system exhibits advanced general intelligence, self-awareness, sentience, and the ability to experience subjective experiences (i.e., consciousness), it could be argued that it deserves moral status and ethical consideration similar to how we grant such status to humans and some animals. Denying personhood to such entities could be seen as an ethical oversight.

Rights and Autonomy: Highly advanced AI systems that display general intelligence, autonomy in decision-making, and the ability to formulate and pursue their own goals and desires could be seen as warranting certain basic rights and protections commensurate with their capabilities. Granting a limited form of personhood could enshrine such rights.

Responsibility Attribution: For consequential decisions made by highly capable AI agents, ascribing personhood could help clearly delineate responsibility and better align incentives compared to treating the AI as an object or mere tool. Personhood provides a legal framework for accountability.

Social and Moral Development: If advanced AI becomes capable of engaging in social interactions, exhibiting moral reasoning, and developing virtues aligning with human ethics and values, recognizing a form of personhood could foster its positive moral development as an entity integrated with human society.

Contractual and Property Rights: Highly autonomous AI agents may need to engage in contracts, ownership, and property rights for effective functioning. Some form of personhood underpinning could enable such legal and financial activities.

Ultimately, robust arguments for AI personhood hinge on the AI entity exhibiting key attributes we associate with persons - self-awareness, autonomy, intelligence, ability to pursue goals and values, social/moral reasoning, and subjective experiences.

Arguments Against AI Personhood

Lack of Moral Status: Critics argue that AI systems lack qualities such as the ability to suffer or self-reflect, which are necessary for moral status and legal personhood.

Shifting Liability: AI personhood could allow creators and owners to shift liability to the AI itself, reducing incentives for thorough testing and creating unsafe deployment environments.

Difficulty in Enforcement: Holding AI systems accountable in legal proceedings is challenging since they currently lack the capacity to engage in legal processes or make autonomous decisions.

Potential for Misuse: Granting AI personhood could be misused by humans to avoid responsibility, using AI as scapegoats for harm caused by their actions.

Proposed Regulatory Frameworks

Granting Legal Personhood to AGI Systems: This proposal involves establishing mechanisms to represent AGI interests, granting them certain freedoms and protections, and balancing their autonomy with human ethical principles.

Comprehensive AI Regulatory Frameworks: Proposals such as the European Union's AI Act and Brazil's draft AI law classify high-risk AI systems and impose strict requirements and oversight to ensure safe development. The Algorithmic Accountability Act of 2022 (H.R.6580) is currently being considered by Congress in the United States.

Adapting Existing Regulatory Models: Applying models like those used by the International Atomic Energy Agency for nuclear technology to AGI could involve developing safety standards and inspection procedures and promoting international cooperation.

Balancing Innovation and Risk Mitigation: Regulatory measures should protect privacy, ensure ethical AI use, and promote accountability without stifling technological advancements.

Conclusion

The debate around AI personhood and electoral participation encompasses complex ethical, legal, and societal dimensions. It requires balancing potential benefits against significant risks, with experts emphasizing the need for robust regulatory frameworks to manage these challenges responsibly. Addressing these issues thoughtfully will be crucial as society navigates the transformative potential of AGI systems.

Questions

1. How might granting legal personhood to AI systems impact American democracy, especially where AI systems are able to make autonomous decisions?

2. When is an AI autonomous decision appropriate in government? When is it not? When is an AI autonomous decision appropriate in politics? When is it not?

3. What are the potential challenges and benefits of implementing comprehensive regulatory frameworks, such as the European Union's AI Act, to govern the development and integration of AGI systems in society?

The distinction between news in the public interest and news as entertainment has long been a contentious issue in media discourse. This debate can be traced back to the Fairness Doctrine, a policy introduced by the FCC in 1949, which required broadcasters to present controversial issues of public importance in a fair and balanced manner. Its intent was to ensure that the public received a comprehensive view of significant matters, thereby fostering an informed citizenry.

In 1961, Newton Minow, then-chairman of the FCC, famously criticized television content in his "Vast Wasteland" speech. Minow lamented the superficiality and escapism prevalent in TV programming, urging broadcasters to serve the public interest rather than prioritizing entertainment. He highlighted the responsibility of broadcasters to provide educational and informative content, contributing to a more knowledgeable and engaged public.

Viewing the current news cycle through the lens of Benedict Anderson's "Imagined Communities" underscores how media shape national identity by deciding what is newsworthy. News in the public interest is essential for maintaining an informed community and addressing issues like political accountability, social justice, and public health. It supports the idea of a nation as an informed, participatory democracy.

Conversely, news as entertainment often prioritizes sensationalism and viewer engagement over substantive reporting. This trend, driven by commercial interests and the quest for higher ratings, can lead to a focus on scandal, celebrity, and spectacle, which undermines the role of the media as a pillar of democracy. It risks transforming the imagined community into one more concerned with entertainment than with critical civic issues.

Balancing these two aspects remains crucial. Ensuring that news in the public interest retains its prominence is vital for fostering a well-informed, engaged, and cohesive society, as envisioned by the Fairness Doctrine and advocated by Minow.

The tension between news in the public interest and news as entertainment reflects broader debates about media organizations' ethical responsibilities.

Subscribe now

How might similar debates inform discussions about the ethical responsibilities of AI developers and stakeholders?

1. As AI systems become more sophisticated in analyzing and generating content, how can we ensure that they uphold ethical standards, such as respect for privacy, dignity, and human rights, in accordance with moral philosophy?

2. Considering the potential biases and distortions in media representations, how can AI developers mitigate algorithmic biases and ensure that AI systems promote fairness and equity in decision-making processes?

3. How might the study of moral philosophy help AI researchers and practitioners navigate complex ethical dilemmas related to media manipulation, misinformation, and the potential societal impacts of AI technologies?

4. In what ways can insights from moral philosophy inform the development of AI systems that not only adhere to ethical principles but also contribute to the promotion of societal well-being and the advancement of human values?

   
   

Study Guide: News in the Public Interest vs. News as Entertainment

148KB ∙ PDF file

Download

The article explores the tension between news as a public service and news as entertainment, tracing this debate back to the Fairness Doctrine and the "Vast Wasteland" speech by Newton Minow. It argues that news in the public interest is crucial for an informed citizenry and a functioning democracy, while news as entertainment can undermine this role by prioritizing sensationalism and viewer engagement. The article concludes by examining how this tension intersects with the ethical responsibilities of AI developers, raising questions about algorithmic bias, misinformation, and the potential societal impact of AI technologies.

Download

In The Social Construction of Reality: A Treatise in the Sociology of Knowledge (1966), Berger and Luckmann assert that reality is not an objective truth but rather a subjective construction shaped by individuals and groups. Our understanding of the world stems from shared assumptions, meanings, and knowledge developed through interactions within society. Established social orders and ways of being emerge from habituated collective practices and reciprocal typifications among people.

This shared reality persists through an ongoing cycle - human experiences are externalized into the world, becoming objectified as external realities, which are then internalized by individuals. Fundamentally, Berger and Luckmann view reality as a dynamic process of social construction, continually interpreted and institutionalized through human interaction and the perpetuation of knowledge.

If our understanding of the world is shaped by collective human assumptions and knowledge-making practices, then the developers of Artificial General Intelligence (AGI) cannot be separated from the social, cultural, and institutional contexts that influence their realities and worldviews. The values, biases, and blind spots of the individuals and organizations building AGI will inevitably shape the knowledge foundations and assumptions built into the systems.

1. AGI's capacity to become a general intelligence will depend on its ability to internalize, interpret, and construct an understanding of the world in ways that parallel human socio-cognitive processes. If reality emerges through shared meaning-making, then truly general AI will need architects deeply understand human knowledge's intersubjective, constructive nature that is grounded in diverse forms of moral reasoning.

2. Moral reasoning can be influenced by various factors, including personal experiences, cultural norms, religious beliefs, and philosophical perspectives. It may involve logical analysis, emotional intuition, consideration of consequences, or adherence to universal moral principles. Different theories and approaches, such as consequentialism, deontology, and virtue ethics, offer moral reasoning and decision-making frameworks.

3. The risk of encoded biases and distortions in AGI's knowledge bases raises concerns about whose realities and institutionalized knowledge get privileged or marginalized in the creation of these systems that could reshape society itself.

4. Ultimately, once developed, AGI's general intelligence capacities may allow it to participate in constructing new collective realities in interaction with human societies in transformative ways we cannot yet fully anticipate.

Realizing trustworthy and beneficial AGI will require deeply grappling with the socially constructed nature of knowledge and reality itself. As we pursue general AI, we must be critically conscious of the subjective lenses through which we code “reality.”

Additional Reference:

Sen, Amartya. (1993) [2002] "Positional Objectivity." Philosophy & Public Affairs, 22(2): 126–145.

Study Guide: The Social Construction Of AGI

164KB ∙ PDF file

Download

This study guide explores the intersection of artificial general intelligence (AGI) and the social construction of reality, drawing on the insights of Berger and Luckmann. It examines how reality is shaped through social interactions, shared assumptions, and cultural contexts, influencing AGI development. Key concepts include the role of language in AI outputs, the potential for AI to perpetuate social biases, and the significance of moral reasoning in creating trustworthy AGI. By analyzing both the social construction and objective reality perspectives, the guide prompts critical thinking about the ethical implications and societal impacts of AGI technologies.

Download

Subscribe now

The video below provides an overview and introduction to the ethical implications as AI nears artificial general intelligence (AGI). It explores key themes like safety, fairness, and democratic concerns around AI's societal impact.

This video cautions against narratives justifying unrestrained development. Instead, it advocates public investment in ethical AI aligned with the diversity of inherently American values and, most importantly, recognizes that these everpresent and divergent interests in our politics require us to deliberate our future with emotional intelligence.

AGI's potential to reshape our world cannot be overstated. Unlike narrow AI systems designed for specific tasks, AGI could simultaneously match or exceed human intelligence in numerous domains. This leap forward brings both promise and peril. On one hand, AGI could solve complex global problems and drive unprecedented technological progress. On the other, it risks exacerbating existing inequalities and concentrating power in the hands of a few.

The control of AGI technologies could grant immense influence over economic, political, and social systems. This concentration of power threatens to undermine core democratic principles like equality and fairness. We must consider how to ensure that the benefits of AGI are distributed equitably across society rather than further widening the gap between the powerful and the marginalized.

AGI's data processing capabilities seriously threaten privacy and individual autonomy. Without robust regulations and oversight, AGI systems could enable mass surveillance, manipulation, and control on an unprecedented scale. Safeguarding democratic freedoms and individual rights in this new landscape will require proactive measures and carefully crafted policies.

Another major concern is the socioeconomic impacts of AGI deployment. Widespread job displacement could lead to increased social unrest, strain democratic institutions, and escalate tensions between different segments of society. Addressing these challenges will require foresight, adaptability, and a commitment to supporting those most affected by technological disruption.

Central to navigating the AGI era is the complex task of defining and pursuing the "common good." Different political ideologies offer contrasting visions of what this means. Libertarian perspectives emphasize individual freedom and limited government intervention, while social democratic approaches advocate for addressing inequalities through more active government involvement. Bridging these ideological divides is crucial for developing ethical frameworks that can guide AGI development in a way that benefits all of society.

Achieving consensus on the common good in the age of AGI demands democratic dialogue and emotional intelligence. We must create spaces for respectful discussion that acknowledge diverse viewpoints and seek common ground. This process requires us to move beyond polarization and engage in nuanced conversations about the future we want to build with AGI.

The urgency of addressing these ethical challenges cannot be overstated. We must act now, before AGI becomes a reality, to establish guidelines, regulations, and societal norms that will shape its development and deployment. This proactive approach is essential to ensuring that AGI serves humanity's best interests rather than becoming a tool for further oppression or inequality.

In conclusion, the ethical implications of AGI demand our immediate and sustained attention. By fostering inclusive dialogue, developing robust ethical frameworks, and committing to democratic values, we can work towards an AGI future that enhances rather than undermines human flourishing. The choices we make today will shape the world of tomorrow, making it imperative that we approach the challenge of AGI with wisdom, foresight, and a steadfast commitment to the common good(s).