Jean Arnaud on AI and the Future

0
19


The arrival of recent applied sciences and synthetic intelligence, with their profound philosophical, psychological, moral, political, financial, and social implications, prompts us to mirror on human nature and expertise, and to outline the horizons in the direction of which we’re headed. We’re honoured to print an interview with Jean Arnaud, a pioneer of the digital renaissance within the fields of artwork, philosophy, expertise, and training. Jean Arnaud is an educator and entrepreneur on the helm of Nova, an organization that develops synthetic intelligence to speed up analysis and fight disinformation. He’s additionally a broadcast writer and artist.

DP:
Mr Arnaud, welcome to Day by day Philosophy! What revolutionary modifications are being pushed by new applied sciences like AI and during which areas are they poised to form our future?

New applied sciences, particularly synthetic intelligence, are poised to decisively remodel the world we all know, very similar to the steam engine that gave rise to the commercial revolution. The impression of AI may be felt throughout a mess of domains.

Within the realm of analysis, for instance, AI, just like the one we’re creating with Nova, ensures researchers entry to high quality scientific literature and, extra importantly, instruments able to accelerating educational analysis. On a bigger scale, the impression of AI includes the event of search engine fashions primarily based on verified data. In training, the usage of clever mentors — particularly, AIs related to avatars in VR, AR, holographic variations, or robots able to helping college students of their studying — has precipitated a basic paradigm shift in customized studying, permitting college students to flee from mass training that has been catastrophic for our democracies. Each citizen should be educated to assume, analyze, and create, and should have reached their full potential to take part within the bigger neighborhood. To place it extra philosophically, one should be “wealthy” in self to have the ability to give.

In its operate of offering help and giving recommendation, AI clearly allows higher efficiency (which is one thing society expects from employees, however that is nonetheless a philosophy, and as such, a set of values that may all the time be contested) and can revolutionize the sphere of labor with the creation of recent professions — for instance, immediate engineers — and with the disappearance of others, leading to vital decreases in employment, like these lately introduced by tech giants, within the identify of productiveness.

As a result of AI excels at probing the huge knowledge we accumulate, which we’re unable to make use of unassisted with a view to finest handle particular issues, AI could also be successfully employed within the transportation sector to enhance route planning, cut back ready instances, and decrease congestion, for instance, in addition to in drugs to establish illnesses and circumstances extra shortly and precisely.

Info bubbles have a tendency to limit a myriad of passions to some areas of curiosity. 

After all, the advantages of synthetic intelligence shouldn’t overshadow the threats it poses, the consequences of that are nonetheless poorly understood. These risks are extra insidious than these conveyed by Hollywood dystopias, exaggerated for the sake of narrative dramatization. One hazard, for instance, would possibly contain overexposure to the systematic patterns utilized by generative fashions comparable to ChatGPT or Jasper, which might have a major cognitive impression. Influencing language is influencing thought, and language fashions, coupled with an inherent laziness in human nature or perpetuated by our applied sciences or academic fashions primarily based on passivity, might result in a narrowing, fairly than an enlargement, of human horizons to a standardization of favor and concepts. Isn’t this already a pattern we are able to observe with data bubbles tending to limit a myriad of passions to some areas of curiosity?

If the fault is certainly human as a result of it’s nonetheless as much as the person to discover the a number of topics of their pursuits, fault additionally lies with the expertise itself, or fairly with its philosophical imaginative and prescient, the kind of affirmed will of its entrepreneurs, and likewise of the researchers and engineers they make use of. For instance, producing higher revenues by selling algorithms designed to keep up exercise on the appliance, i.e., to use its addictive tendencies fairly than its actual potential — rising its energy of being — is all too typically behind the imaginative and prescient, the philosophical concept, of the expertise. Or should you desire to say it in another way, the need (each will is subjective; even when it claims objectivity, it carries with it a set of values and beliefs, in addition to a metaphysical background that guides its motion and determines its consequence, whether or not in an inventive work or an mental manufacturing) that presides over the event of a expertise is the worth by which it may be measured.

DP:
What different philosophical questions does the event of recent applied sciences like AI elevate?

New applied sciences comparable to AI invite us to look at quite a few inquiries that aren’t merely philosophical however are additionally moral and typically very sensible, contemplating the profound modifications they introduce into society, that are no less than as vital as these witnessed through the industrial revolution. The query of what we’re — what defines us as human beings, what constitutes our nature — arises once we discover ourselves within the presence of a creation that now we have desired and formed in our picture, a creation that’s clever. We should not overlook that synthetic intelligence is just one potential interpretation of human intelligence, one that’s really of a totally totally different nature. It additionally doesn’t obey the identical mechanisms and, finally, doesn’t have the identical capabilities or the identical intentions. The truth that synthetic intelligence excels within the execution of sure particular duties nearly inevitably results in the thought that it will likely be able to changing human intelligence, however it’s exactly its virtues — its extraordinary analytical skills — that doubtlessly make it an distinctive ally. It’s nonetheless as much as the human being at work within the machine, the modeler, to resolve — no less than so long as AI is just not endowed with a will of its personal, that’s, so long as it doesn’t have the flexibility to resolve for itself or to reform itself. Proper now, that idea nonetheless belongs to the realm of science fiction.

The precise state of technological developments relating to AI has taught us, above all, simply how a lot human beings — as a result of we’re alive and in perpetual transformation, as a result of we’re by no means simply static entities however all the time in a state of turning into — differ from the machine. A machine’s potential for evolution depends upon exterior changes, on human intervention. This makes the true modeling of its intelligence, which might require a deep and exact understanding, advanced, and demonstrates how such modeling is illusory and chimerical. This different entity that’s synthetic intelligence, without delay each lesser and greater than human intelligence, may be employed to extend our information, to excellent our instruments, and to increase our mental or inventive concepts.That is the horizon in the direction of which we navigate, one which constitutes the elemental existential query, these forthcoming skies that we nonetheless want to find out and form with our visions. It’s right here that philosophy now not asserts itself merely as a mode of inquiry; philosophy additionally turns into a way of evaluating and creating, because it falls to the free and sovereign thoughts to outline the values able to embodying the perfect sort of human being to which our time aspires. As a result of every little thing calls us to higher accountability, the very accountability we desired once we emancipated ourselves from the traditional gods — maybe that is the eloquent lesson of the traditional fantasy of Prometheus or of Shelley’s Frankenstein — it’s completely vital to contemplate the human being who’s to come back, the one we want to see emerge, and the longer term world of which they would be the embodiment—one which we nonetheless should construct. Every part we create nonetheless bears a lot of ourselves, which is why, with out eager to dominate the event of all our ideas, all our productions — mental, inventive, and technological — it’s nonetheless potential for us to information this course of in an enlightened method, bearing in mind what we want, what includes our will, the necessities of the fact with which each concept should deal.

Nevertheless, we should additionally attempt to envisage the imprints that each new existence leaves upon the world and all of the potential ramifications (it will be illusory to say that we are able to completely dominate and management them). Every part we produce additionally escapes us (maybe that’s the different main reflection we are able to draw from the 2 myths talked about beforehand). That is exactly what the dramatic penalties of local weather change have taught us.

Whereas it’s sure that the emergency scenario during which we discover ourselves as we speak may be attributed to our refusal to heed the phrases of scientists for the reason that Nineteen Seventies and to contemplate rigorously the information they offered, it’s also possible that this case could also be the results of a blindness to the impression of a philosophy of greed on each people and society as a complete (the philosophy during which self-interest alone prevails founds all the conventional Western capitalist mannequin, which is devoid of ethical conscience): a society of consumption and leisure, deeply unequal, with minds, characters, and emotions impoverished in look, flight, and self-diversion. To flee, to take refuge in willful blindness, in handy and culpable silence, is to resolve to desert the accountability of that means that’s the province of humanity; it’s to conform to enslave the facility of the is not going to to the yoke of the indifference of nature or the world (the world is far more than a mere phenomenal entity, no less than for the human being; it’s a humanized phenomenon — interpreted, intellectualized, and subsequently subjectivized. If there’s an goal being of the world, it could solely be dynamic, in movement and in perpetual transformation, a turning into, inaccessible to the being besides as founding matter, a collection of beings figuring out themselves together) however to that of a completely human sense, decided regardless of oneself, via renunciation and wholly voluntary abdication. Every part within the human world is a alternative, even silence (is silence not additionally, for instance, a part of music and does it not make much more music?).

By concentrating our mental and technological forces within the service of superficial materials progress (to not say materialistic) and of a scientific progress with out conscience, that’s, with out spirit and with out taking the accountability of a imaginative and prescient that we should always have thought and outlined upfront, we lose in substance, in depth, and in humanity. Humanism can’t do with out science and artwork, and it can’t do with out philosophy and ethics both, which give every little thing that means (thoughts) and worth (conscience).

Know-how and the paradigmatic modifications it introduces compel us to consistently rethink the state of our creations, and likewise that of societies, their potential developments, and their potential penalties. Tweet!

Thus, with out succumbing to the pessimism of the preachers of an apocalypse paralyzed by irrational nervousness or to the keenness of the idealists whose religion embraces with an nearly fanatical ardor all novelty with out reflection, with out the mandatory distance for any choice to be rendered simply and cheap, we are able to think about expertise to be virtuous and helpful when it’s thought out, when it’s used within the service of a philosophical imaginative and prescient geared toward rising our capability to query, to research, to guage, to create, to push the bounds of what’s potential with out annihilating it by dire prediction or chimerical exaltation. The query of the restrict and its past then turns into the middle of philosophical and moral inquiry as a result of expertise and the paradigmatic modifications it introduces compel us to consistently rethink the state of our creations, and likewise that of societies, their potential developments, and their potential penalties. To what extent can these devices hint the brighter strains of the horizons we wish to see come to move? It’s nonetheless as much as us to outline that, since it’s, in actuality, thought that determines and tasks a specific imaginative and prescient of being and of the world. With science, an concept takes root and embraces the dynamic phenomenon “world” (for the world is in fixed movement and transformation), its possible actuality (particularly, our human interpretation of this world), and the expertise that’s used to perform it.

DP:
What are the challenges of our societies within the face of AI?

The widespread and speedy adoption of AI techniques like ChatGPT and OpenAI’s DALL-E naturally compels society as a complete to deep reflection, which particularly applies to governments and lawmakers who should perceive the precise scope of the consequences on a person’s psychology and society as a complete with a view to make efficient coverage selections able to addressing the transformations induced by these new instruments, the ramifications of that are nonetheless tough to measure and perceive. Based on a current article in Forbes, citing a research performed by Goldman Sachs, 300 million jobs could possibly be eradicated by AI — contemplating the expertise is meant to advertise worker productiveness and firm competitiveness — earlier than the job market can regain stability and enter into an period of potential progress with the emergence of recent requirements and alternatives. It’s as much as our leaders to search out options to forestall financial and social crises from creating, options comparable to subsidies for corporations that select to not lay off employees however to coach them, the implementation of a common fundamental revenue to forestall a rise in poverty and the accompanying scourges of crime, rebellion, and the rise of extremist and radical actions that preach division by in search of scapegoats fairly than options, and even taxes on these applied sciences. To facilitate this, it’s vital to manage developments and, with out slowing them down, be certain that their results may be managed. That is the problem outlined within the regulatory charters that Europe has embraced by organizing roundtable discussions with consultants, during which my co-founder Michaela Jamelska was lucky sufficient to take part.

We should additionally handle the moral facet of the psychological stress on workers related to the adoption of AI, because it now appears clear that any resistance to the expertise will nearly inevitably result in dismissal. A employee who refuses to make use of AI must work more durable to realize the identical consequence as somebody who successfully makes use of it to serve their objectives. What was as soon as a alternative is now not so or will, no less than, turn into a alternative that’s tough to face by. From an moral perspective — and from a humanistic one — this imposed adoption is debatable, even perhaps insupportable. The vitality consumption of AI poses one other vital problem, because it provides to all the opposite current applied sciences already recognized as energy-intensive and essentially calls for brand new innovations or discoveries to handle it. We will add id theft to this non-exhaustive checklist, and all of the potential adverse penalties, notably with the manufacturing of faux photos and misinformation, which might result in the speedy adoption of blockchain expertise on one hand and the institution of a digital id on the opposite. It now appears apparent that the free web, which was already a fiction, will turn into more and more managed with extra extreme and vital sanctions (amongst victims of digital discrimination, there typically exists a horrible and bonafide feeling of injustice, whereas tech giants comparable to Google set an notorious instance of impunity).

When assertion takes the place of doubt and inquiry, there’s a actual threat of a decline in thought. Tweet!

Within the subject of training, a number of of us have recognized future helpful developments of AI — for instance, an clever mentor able to guiding college students in reflection, understanding, planning, and offering customized training during which the coed turns into the actor of their very own studying — however now we have additionally recognized sure dangers related to the usage of AI, exactly as a result of as a substitute of selling an energetic and reflective strategy, its use might encourage passive conduct. As a substitute of stimulating reflection and a journey in the direction of potential solutions (a reflective strategy) when a query is requested, these instruments solely present a single, unambiguous reply (a dogmatic strategy). When assertion takes the place of doubt and inquiry, there’s a actual threat of a decline in thought. To forestall AI from turning into a substitute and to encourage its aware use for academic functions, that’s, as an assistant able to enhancing our mental and inventive colleges, it will likely be essential to think about a extra reflective and philosophical strategy, one much like Socratic maieutics, which consists of questioning one’s interlocutor to information one in a single’s pondering and encourage one to develop their very own ideas. It’s with this philosophy that some corporations attempt to develop interactive fairly than generative synthetic intelligence techniques, such which can be substantial and primarily based on verified data, and with which everybody can co-construct and co-create.

It might take too lengthy right here to debate all of the challenges our society faces with AI, however amongst them, we are able to point out the respect for personal knowledge (there’s a severe concern that our photos can be captured by surveillance cameras and processed by AI with out our consent), and the safety of mental property, which has been compromised by AI techniques whose coaching relies on opaque and typically protected materials. This has lately led The New York Occasions to sue OpenAI for copyright infringement.

Thus, AI has prompted us to query what was as soon as accepted as apparent, however that which doesn’t essentially maintain true, the very notion of mental property. The controversy over the legitimacy of claiming possession of a piece is intensifying as a result of if a creation actually displays the distinctive spirit and interior world of its creator, in addition to their intense labor and funding, we should acknowledge that every work is definitely the fruits of a sequence of prior ideas, efforts, and productions. Nothing comes from nowhere, and each work is, to a sure extent, a recombination, a recomposition.

When the inventive course of is stripped of its mystifying cloak, it may be understood that the criticisms leveled at AI within the inventive area, if not unfounded from an moral perspective, are primarily based on maybe an illusory conception of the artistic course of. Way over impressed by the traditional custom of poet-hierophants, the outdated Vates, these mouths via which the whispers of the heavens and supra-celestial wills move, all mental and inventive manufacturing is impressed. It’s a legacy that’s carried greater, tinged with the hues of every particular person’s soul. Rather more than expertise is required to outline the depth or fantastic thing about a piece; it’s the act of engaged on oneself, the sculpting of oneself and of the world, the flexibility to create oneself whereas creating; it’s the capability to understand the invisible richness of worlds, as Rilke recommended (in Letters to a Younger Poet), to reinforce them by nurturing their fruits inside oneself; it lies in a single’s personal physiological transformation, the results of an ontological quest to which all paths of immense creation lead; it’s within the spirit’s situation and its philosophy, in a real artwork of being, residing, pondering, and creating, that the worth of a piece is discovered; It’s as a result of thinker or artist’s skill to understand worlds, to imprint them with the notes of their soul, and to enlarge them into “universes”.

If the situation of the thoughts that presides over a creation determines the mental and aesthetic excellence of a piece, or to phrase it in another way, if the soul — that’s, “the self” within the strategy of turning into, embraced and deepened by “the me,” and powerfully incarnated — contributes extra to artwork than mere expertise does, then the poetic intention current in a textual immediate might end in a pictorial and inventive work that’s extra intriguing than what a gifted picture creator can produce.

The actual fact is that true artists are uncommon — it’s already Gogol’s critique in his Mysterious portrait — and it could be good that they’ll entry different types of artwork that have been beforehand closed off to them (aside from via collaboration). AI opens up, fairly than closes, views: A poet can now be a painter, and a painter generally is a poet through the use of a textual immediate to provide photos, for instance, or a visible immediate to provide textual content. This symphonic or synesthetic strategy permits us to transcend the concept that reduces artwork to mere craftsmanship since, as now we have famous, it’s clearly far more than that.

In actuality, generative AI instruments for artwork are simply devices that intellectuals and artists can select to make use of in service of their imaginative and prescient, or select to disregard, simply as composers have identified for a few years that one can create music with out really understanding the way to play all of the devices one makes use of — so long as one is aware of the software program and the way to manipulate it. A distinct notation replaces conventional codification. A brand new path is opened for creation. Have these software program instruments changed devices? Moderately they’ve been added to different strategies of composing music. Addition doesn’t essentially result in elimination. The brand new doesn’t fatally change the outdated; and typically it could enrich it. These new applied sciences have given non-musicians (within the conventional sense) the chance to be wonderful composers, and now enable non-writers to turn into poets or artists. Those that lacked the language can now deliver their concepts to life and will change the dusty skeletons from academies who know the way to write however whose writing is bland and lackluster, devoid of concepts and spirit. AI is finally simply one other instrument, one which should be discovered and used with goal. As for the strategy to AI itself, I consider in interactive engagement fairly than mere technology, that’s, in co-creation, in using AI as an assistant, an ally in creation.

It’s through the use of AI in its suggestive operate that we are able to develop our concepts and inventive visions. Tweet!

It’s by constructing with synthetic intelligence that the fields of our personal willpower are opened, everything of which we’re composed and which constitutes the matter from which the questioning being, the analyzing being, the deciphering being, and the creating being incessantly draw. It’s the international, the various, the unknown that we reclaim by readjusting, by reweaving in another way what AI has proposed. It’s through the use of AI in its suggestive operate that we are able to develop our concepts and inventive visions. Charged with this novelty, we resolve to work in another way, to throw ourselves absolutely into “the Open” to make use of a time period expensive to Heidegger, and to make it bloom anew with our personal colours. Once more, it’s as much as philosophy to outline what we imply by a murals and the spirit that characterizes our period. The problem of AI remains to be, and above all, a human one, exactly as a result of it could make us extra human or superhuman. Know-how is just as useful because the spirit that guides it. Solely by grounding ourselves in humanistic existentialism can transhumanism result in a Nietzschean “superhumanism” that’s, to an enhanced humanity that has turn into what it could possibly be at its most completed. We should take into consideration the longer term being and the world earlier than we are able to create them.

DP:
Are you able to clarify to us to what extent technological progress leads us to what you name a “new renaissance”?

As I discussed earlier, expertise compels us to query and rethink current paradigms, making us contemplate that what we thought was the reality may need solely been a perspective, a potential interpretation of actuality and existence. We share with the beings of the Renaissance these philosophical inquiries, which on the time have been provoked by the good discoveries of explorers but in addition, and above all, by the rediscovery of historic information as a result of fall of Constantinople and the Jap Roman Empire, and the arrival of students in Europe. A brand new world was opening up past the bounds of the one we thought we knew, and historic texts provided reflections profoundly totally different from that of the triumphant imaginative and prescient of a sure Christianity consecrated by the Church. As occurred of their time, our certainties are shaken, and now we have been pressured to search out solutions inside ourselves, and likewise to search out them up to now, by opening ourselves to different views. Maybe therein lies the reason for the renewed curiosity in historic philosophers like Heraclitus, Marcus Aurelius, or Seneca. It’s also understood that, to develop our horizons and the sphere of potentialities, we should even be extra versatile, construct bridges between information domains, and surpass what constituted the restrict in every area. Nevertheless, the keenness that these residing through the Renaissance should have felt when the traditional world collapsed and a brand new world was outlined (an enthusiasm that later resurfaced with positivism and religion in science because the supply of progress within the nineteenth century) remains to be restricted in our time as a result of now we have skilled “the age of suspicion,” to borrow Nathalie Sarraute’s expression, the usage of applied sciences for lethal and disastrous functions, such because the atomic bomb when nuclear fission promised scientific progress with multiplied vitality.

Since Camus’s writings, abdicating accountability for the world has turn into an untenable place. If nature is detached and has no inherent that means, it’s as much as us to create one as a result of human beings give that means even once they declare to not. Victory, subsequently, lies not a lot in having annihilated our gods or freed ourselves from our idols — which regularly results in the worship of different statues, different dogmas (a degree that’s nonetheless debatable as we might dedicate ourselves to the gods of Cash, Utility, Reality, Order) — however fairly in our skill to outline what makes us free, sovereign, and highly effective.Which means the persistence of effort current within the being journeying in the direction of this new star, the need on this being, will all the time turn into greater than itself.

Thus, we discovered with Hiroshima and Nagasaki that expertise is nothing however the reflection of our will. If we aspire to a extra enlightened world, then we should be extra constant in our personal selves once we invent. The digital renaissance is thus not solely technological; it’s also, and primarily, philosophical.

Certainly, it’s not shocking to witness engineers, entrepreneurs, philosophers, artists, and scientists collaborating in essentially the most superior laboratories across the globe. Our datasets are overwhelming, our brains incapable of sustaining the mythic genius that after served extra for present than for development and perseverance when cultivating a “higher being” — an existence that’s enriched and enhanced.

The calls for of experience throughout varied disciplines are such that though versatility is required and inspired, mastery in a number of fields is just not possible. Thus, we discover ourselves in a brand new period the place versatile consultants, with the help of AI and supercomputers, collaborate, shifting past the archetype of the lone genius whose brilliance ought to have all the time been stoked by the enduring flames of “labor.”

As a result of we creators are nonetheless the masters of our machines (even once we resolve to not be), and since we wish to develop our science with consciousness and accountability, we should first outline what we would like for ourselves and for our societies. I consider that is embodied by my polyphonic and palimpsestic 3D statue within the metaverse, my Prometheus Ἑωσφόρος — the bearer of daybreak — a human being pushed by the thought of being greater than himself and of making a extra enlightened world, rising in the direction of new heavens to ascertain a brand new order. He places on the service of his highest goal: his love, his will and willpower, his purpose, his creativeness — and with them their most sacred merchandise: philosophy, science, expertise, and the humanities.

A brand new period calls for brand new beings, and Prometheus Ἑωσφόρος rises, matured by and past himself, erecting pillars to reign within the heavens with all his mild, whereas remaining deeply rooted within the true that means of the earth. Like many, we are able to now not tolerate a capitalism with out conscience, a expertise devoid of morality, a progress with out spirit, which has led us to devour ourselves in addition to the environment, to turn into our personal predators and our personal peril. The mannequin should be reconsidered, and we’ll solely rethink it with the assistance of an AI able to analyzing with higher precision everything of the information we possess and have amassed lately. It might be helpful to have, alongside our dystopias that merely exaggerate the options of an interpreted current and draw essentially the most dramatic implications from it, utopias that demand a drive of invention that’s philosophical, inventive, scientific, and technological, particularly once we purpose to comprehend them.

DP:
You might be additionally main an AI firm. How does one go from thinker to entrepreneur? Isn’t there a basic and nearly irreconcilable contradiction there?

Removed from opposing one another, these two actions complement and enrich each other.

Reflection results in simpler motion. Entrepreneurship is the need to enact a thought. It’s the transition from idea to observe. With out idea and reflection, concrete manufacturing lacks substance. With out observe, thought can’t actually mature and have an effect on the world, as a result of it should be rooted on this planet with a view to impression it. Novalis poses a wonderful query in Heinrich von Ofterdingen: What worth can thought have when it’s indifferent from any type of actuality? Right here it’s only an mental sport, which can suffice, however I consider the world is our accountability, and if thought, science, artwork, and expertise can elevate us as beings, they need to then aspire to what transcends us, producing past that which is bigger than ourselves — humanity. Above every particular person, humanity nonetheless shines (Soliloquies).

DP:
The final phrase?

How about posing a query: What’s the goal of creation if to not amplify our strengths and our humanity? To assume earlier than performing, which may simply be the one factor we actually have to do.

DP:
Mr Arnaud, thanks a lot for this interview.

◊ ◊ ◊

Jean Arnaud is a pioneer of the digital renaissance within the fields of artwork, philosophy, expertise, and training. He’s a Stanford College alumnus and former literature and philosophy professor at Université Côte d’Azur. He’s additionally entrepreneur on the helm of Nova, a Boston-based startup (USA) that’s creating an AI utility to speed up educational analysis and detect misinformation and forgery in scholarly papers. Jean Arnaud is a board member of La French Tech Boston (USA) and Blockchain Innovation in Cannes (FR). He’s additionally a member of the Rotary Membership Cambridge and FACCNE. Moreover, Arnaud is a digital artist, a published author, and a speaker at venues like Harvard, SXSW, French Library, and NFT NYC.

Cowl picture equipped by Jean Arnaud.

Share this:

Related





Source link

LEAVE A REPLY

Please enter your comment!
Please enter your name here