The Augmentation of the Real World

Introduction

“When parts of the environment are coupled to the brain in the right way, they become parts of the mind”
- Andy Clark.

In the short movie Sight we are presented with a future where people use the sight system, which consists on eyes implants that allow individuals to have different layers of digital data on the physical world. This future is not so far from where we are right know, considering advancements in mobile devices and wearable technology, such as Google Glass. Although none of the devices we have right now have the capabilities shown in Sight, many individuals and institutions are working on creating and making mix and augmented reality possible.

As shown in Sight, this type of technology brings about many questions of privacy, technology dependence, the gamemifications of social life and so forth. It is because of this that I believe that is important to deblackbox it; to understand how it works and the possibilities that mix and augmented (MAR) reality poses to people. The development and advances on mobile devices and smartphones has made it possible for more people, institution and companies to explore and create augmented reality (AR) apps.

Doing a search on Apple’s Appstore in November of 2014 would reveal 500 + AR apps, most of them focusing in games and advertisement. One of the most interesting one is Wikitude, which has different features, including augmenting advertisements and billboards.  One of the features that I found most compelling is the one that provides the user layers of geographical information of places near her/him (Here is a video of how it works, however it is not showing the more updated version of the app). The user is presented with different layer options that range from TripAdvisor to Wikipedia. Let’s say we choose to use the Wikipedia layer, this would create a layer on your smartphone with “balloons” that pinpoint the location of places that have been geotagged in Wikipedia entries and articles. This allows the user to move around her/his physical space with more information about it.

Augmented Reality

Before starting the discussion on AR, how it remediates our world and how it helps us offload parts of our cognitive process, I believe it is necessary to have a definition of what Augmented Reality really is.

Augmented Reality (AR)

Virtual Reality (VR)

As Azuma (1997) notes, AR is part of what is known as virtual environments (VE). AR is situated within a continuum between virtual environment and real environment (see image below). At one end of the spectrum we have virtual reality (VR), which is characterize to immerse the user into a digital world, usually by using a headset (Oculus Rift). In contrast to VR, AR mixes the real environment with digital graphics and data (Azuma, 1997; 2), although AR applications can work with headsets or other types of devices (smartphones).  For Azuma (ibid.) there three essential characteristic that define an application as AR. First it has to mix the real with the virtual, it has to be interactive in real time and it is registered in 3D. This definition will give us a framework to work with AR applications and will keep us on track while discussing how it applies in different situations.

Combination of Technologies

Standards

Remediation of the Real World

RHypermediacy, Impressionism and Interfaces

Distributed cognition

RConclusion and Questions

Bibliography:

  1. Azuma, R. (1997). “A Survey of Augmented Reality” in Presence: Teleoperators and Virtual Environments 6 (4). Pp. 355-385.
  2. Barba, E. ((2014). “Toward a language of mixed reality in the continuity style” in Convergence 20(1). Pp. 41-54.
  3. Bolter, J. (2000). “Remediation: Understanding New Media” MIT Press.
  4. Clark, A. (2008). “Supersizing the Mind:Embodiment, Action,and Cognitive Extension”. Oxford University Press, New York.
  5. Clark, A. (1998). “The Extended Mind” in Analysis 58(1). Pp. 7-19.
  6. Engberg, M; Bolter, J. (2014). “Cultural expression in augmented and mixed reality” in Convergence 20(1). Pp. 3-9
  7. Gurevicht, L. (2014). “Google Warming: Google Earth as eco-machinima” in Convergence 20(1). Pp. 85-107.
  8. Holloway-Attaway, L. (2014). “Performing materialities: Exploring mixed media reality and Moby-Dick” in Convergence 20(1). Pp. 55-68.
  9. Hutchings, E. (2013). “The cultural ecosystem of human Cognition” in Philosophical Psychology 27(1). Pp 34-49.
  10. MacIntyre, B; et al. (2001) “Augmented Reality as a New Media Experience” ISAR '01 Proceedings of the IEEE and ACM International Symposium on Augmented Reality (ISAR'01).
  11. MacIntyre, B; et al. (2011). “The Argon AR Web Browser and Standards-based AR Application Environment” In ISMAR. 
  12. Papagiannis, H. (2014). “Working towards defining an aesthetics of augmented reality: A medium in transition” in Convergence 20(1). Pp. 33-40.
  13. Tinnell, J. (2014). “Augmented reality and impressionist aesthetics” in Convergence 20(1). Pp. 69-84.
  14. Samanci, O. (2014). “Embodied site-specific animation” in Convergence 20(1). Pp. 14-24.
  15. Starling, A. (2014). “Invisible visualities: Augmented reality art and the contemporary media ecology” in Convergence 20(1). Pp. 25-32.