Games conferences and new media as academic publishing

“I feel like we can move faster at conferences than you can with writing and reading papers and books.” –  quote from an interview with a developer. LSD28824.

Keywords: ,

Who will find this scenario particularly interesting? , ,

Description

Instead of using traditional academic resources, games industry conferences were framed as ‘nexus points’ of knowledge sharing within the game development community. However, industry conferences are not always amenable to academic contributions because of perceived/actual problems of accessibility of academic language, data presentation, timeliness, or the lack of immediate practical implications from the research.

In addition to industry conferences for knowledge sharing, developers have responded positively to webinars, online videos, and blog-posts on industry websites such as Gamastura.com or GamesIndustry.biz.  In the Gaming Horizons project, the ten webinars on a variety of research topics (such as cultural sensitivity, educational contexts for game usage, and the importance of realism in video games) have been seen by over 6000 viewers on the Facebook Live system. This demonstrates a reach significantly larger than most academic research activities and traditional dissemination methods. These views came through actively involving professional game developers and publishing directly to developer communities rather than to academia.

While researchers need to be more adaptive in how they distribute their work, governments and universities need to acknowledge that their systems and standards of measurement may be outdated. Researchers are typically judged on the impact of their work, and conference presentations and new media are typically rated as being of lower impact than a journal publication, regardless of the readership. Developers have a highly practical mindset, they desire knowledge that will assist them in improving the games that they are making, and so changes in researcher assessment, and publication style, content, and dissemination methods are necessary to bring the academic publishing closer to the needs of the industry.

Meet Yana, a games conference organiser and Ebba, a video game researcher.

Ebba has been working hard to find new ways of signifying potential interactions in video games, but she hasn’t had backing from her university to fully demonstrate this working in a game, only journal publications. Yana is interested in getting speakers for her conference with proven, applicable results – academic theory isn’t enough to impress her practically-minded attendees.

There are many challenges regarding making academic research appealing to industry professionals. Academic research needs to remember that interests of practical applicability and approachability are foremost for many professionals. If the mode of expression and the content can be framed correctly, many of the Gaming Horizons developer stakeholders were positive about the prospect of getting researchers involved in their work but didn’t currently feel that there was communication in a way that was meaningful to them.

Governments and their academic bodies will also need to give adequate recognition and status to applied research. While the split in ‘fundamental’ versus ‘applied’ research is also seen as a split between ‘real’ and ‘low quality’ research, academics who are desiring a strong career will be pushed away from creating research with the practical implications that professionals demand.

Likewise, national and EU funding bodies will need to support researchers working towards practical outcomes for games developers, and recognise in funding calls that industry conferences and new media outputs (for example YouTube demonstrations and tutorials) are much more desirable and potentially impactful than journal publications. Conference attendance for delivering research results and other new media dissemination methods must be supported financially.

In a nutshell

If academic research is to enter a discourse with professional contexts, it will need to adopt the methods and media that the industry uses.

This approach must also be supported by governmental and academic institutions understanding that industry conferences and other media are more impactful than traditional models (such as journal publications) in this domain.

Resources


Suggest a resource for this Scenario

Resources may include readings (books, scientific articles and news), blogs, interesting games, videos...

Latest tweets

@gaming_horizons

Research on technology, education and games: disciplinary divisions and their discontents

“Unlike some of the games research that I tend to come across, where researchers are really interested in ‘does a game increase this, does a game lead to more motivation or better outcomes’, what I’m more interested in (…) is really looking more closely at the role of interactions, social interactions that are happening around games” – quote from an interview with a researcher. R13.

Keywords: , ,

Who will find this scenario particularly interesting? , ,

Description

In our own research, we found that academic researchers and game developers rarely communicate with each other. However, it soon became clear that deep divisions also exist within the academic world itself, in particular between:

  • a psychological or social scientific perspective still vigorously seeking to confirm or debunk the causation argument (‘video games cause x‘), focusing mainly on commercial, off-the-shelf games;
  • an outcome-oriented, engineering and computer-science perspective working mainly with applied or serious games, often with an educational focus;
  • An emerging, fluid ‘game studies’ perspective interested in a variety of issues, ranging from the technical aspects of game design to the cultural practices, identities and politics associated with games.  

These distinctions are leading to bodies of knowledge that do not interact; the respective proponents often treat each other with suspicion due to ingrained theoretical and methodological differences. This problem runs deep in the entire academic world and is compounded by the fact that small and large scholarly communities tend to gravitate around highly selective journals and specialised conferences. In a field so practically (and commercially) oriented like game development, this is particularly confusing and unhelpful. How are developers – established or aspiring – hungry for knowledge and advice about the cultural and educational ramifications of this medium supposed to engage with such a fractured landscape?

Meet Jane and Deka, two researchers

Jane is an internationally established psychologist and computer scientist who published extensively about video games and human behaviour. She is an affirmed university professor and the editor in chief of a top-ranking scientific journal that often features research involving video games. Recently, Jane’s university launched a new, experimental undergraduate course in video game design. The course was designed through consultations with industry veterans and most of the staff have little academic experience, but plenty in game development. One faculty member is Deka, who shifted to academia after several years working as level designer for a successful game studio. She is now trying to develop her own original research agenda, drawing on her professional experience and her personal views as a woman of African descent. During the time spent in the industry, she came to realise that game development is influenced by a multitude of cultural factors. In particular, she grew increasingly dissatisfied with the high-powered, ‘macho’ culture that dominates the sector and with the unhealthy working practices (the so-called ‘crunch’) that burn out many talented developers. She is finding it very difficult to secure funding to do some research. So far, she has only managed to publish a conceptual article in a cultural studies journal that examines how her personal trajectory in the industry, and her personal heritage, influenced her professional output as a level designer.

One day, Deka and Jane meet at an internal networking event, which is part of a mentoring scheme that connects early career academics with more senior colleagues. Although they have been paired as ‘video game researchers’ at different career stages, it quickly becomes apparent that Deka and Jane have rather different views on this medium, the type of  research needed, and who should be the audience for such research. From Jane’s perspective as a psychologist, research on effects, influences and risk factors is relevant and highly valued in the scholarly community. From Deka’s industry-centric perspective, research should focus on how to make gaming a better medium: more responsible, accepting, diverse, deep, complex, culturally relevant and so on.  Jane and Deka meet several times after their first meeting and, gradually, what began as a traditional mentor-mentee relationship evolves into a mutual learning experience. Thanks to Jane’s guidance, Deka becomes more familiar with the complexities of funding applications and peer review. Jane, on the other hand, gains a valuable insight into the changing cultures and values of video games and game development, beyond the confines of her academic community. After some time, they decide to write an article together, focused on the need for more interdisciplinary research that reflects the changing nature of video games and their growing cultural relevance.

In a nutshell

The tendency of academic research to operate in ‘silos’ has been accused many times before of being counterproductive and not conducive to the sort of social impacts funders increasingly seek. The situation is unlikely to change until the current system of specialised journals and conferences is challenged. This state of affairs is particularly unhelpful in emerging multidisciplinary fields such as ‘gaming research’.  

Universities, journal editors and conference organising committees in the area of gaming research should focus more on establishing mechanisms and platforms for researchers from different backgrounds and with different research interests to collaborate.

Latest tweets

@gaming_horizons

Bridging the research-development gap

“I must admit I don’t read academic papers on games. To be honest, I’m not sure where I’d go to find them if I did”- Quote from an interview with a developer. LSD28830. 

Keywords: ,

Who will find this scenario particularly interesting? ,

Description

Game development and social sciences research on games seem to run on parallel tracks, and rarely inform each other. Our understanding of games is weakened by the disconnect that exists between the people who study games and those who create and sell them. While a perfect alignment of priorities between industry and academia may not always be possible, or even desirable, both worlds can benefit from sharing expertise and resources with each other.

In our own research, this disconnect was more acutely felt by developers, who overwhelmingly reported feeling very distant from academic social sciences research on games. They found it difficult to access findings because of unfamiliarity with both the dissemination channels (i.e. scientific papers and academic conferences) and for the technical language used in the contributions themselves. They also reported dissatisfaction with the pace of academic research, seen as too slow in the face of a constantly-changing industry. Lastly, they told us of a mismatch between their priorities and those of researchers: the kind of questions investigated by social research often focus on the educational outcomes of serious games and offer fewer insights that could be used for commercializing entertainment games. On the other hand, the developers interviewed wished for more psychological and humanities research on games, especially on the narrative aspects, and were keenly interested in the discussion of game-related findings in non-academic contexts.

In this scenario, we sketch some possibilities for fostering closer collaboration between academic researchers and entertainment game developers. These forms of collaboration should respect the differences in priorities between the different stakeholders: the goal is finding a way to adapt academic research to a particular context without compromising on its values, and possibly making it more efficient and incisive. On the other hand, the need for developers to gain clear and applicable findings should be understood and taken into consideration.

In the wake of the Open Science Movement, we propose a form of industry-academia collaboration that can generate benefits for both parties and push forward research on entertainment games by embracing the most challenging aspects of studying a widespread, rapidly-changing phenomenon.

Meet Emily, a researcher and Robert, a game developer

Emily is a social psychologist in the US, especially interested in studying factors related to discrimination of outside groups. She believes her studies have applicability to real-world problems, such as finding ways to dampen factors contributing to racial prejudice.

Her work is mainly based on lab experiments, in which participants are randomly assigned to groups that compete in tackling several tasks. In her studies, she explores how modifying different contextual variables (such as group size and composition, level of competition, difficulty and type of tasks to be completed) influences verbal aggression between different groups. However, she worries that the laboratory setting is negatively impacting the validity of her results. Her participants mainly comprise highly-educated psychology students, who tend to be self-conscious about their behaviour during social science experiments. Additionally, engagement in the tasks to be completed is sometimes low: some of the subjects participate as a personal favour, but find the activities boring and find it difficult to enter in a competitive mindset.

After discussing her concerns with some colleagues, Emily identifies multiplayer games as a possible way to obtain ecological data on group-based competition and discrimination. In a game, participants would be highly engaged in the activity itself. Furthermore, since many players conceptualize games as a ‘free space’ in which they can behave naturally, they are less likely to restrain themselves for social concerns. However, in order to obtain the data she needs, Emily has to have access to the game code itself.

Emily contacts Robert, who works for a game company that developed a Multiplayer Online Battle Arena (MOBA), proposing a partnership between the company and her university. They are a large company and have some capacity for investigating new approaches to improving their game without interrupting their core business model and production cycles, a possibility that a smaller company is unlikely to have. While discussing the proposition with the developers, however, it becomes clear to Emily that Robert expects his company to get something in return for their collaboration. One possibility would be to directly pay for access to the data, but that would take up a significant proportion of Emily’s research budget . She proposes instead to offer her expertise and labour in return, by helping design a system for reducing in-game verbal aggression.

Robert is interested in her proposition, because it would help increase player retention in his game. However, he is worried about access to research results, and he informs Emily that the company will want exclusive access to findings obtained through the data. Emily’s priority, in contrast, is to disseminate her findings as widely as possible, by publishing them in Open Access papers and presenting them at international conferences.

In order to make the collaboration successful, Emily writes and proposes an agreement that goes into great detail about the issues she most cares about: what kind of data should be collected, which of the data and analyses should be made publicly accessible, which kind of findings will be her own intellectual property, and how players are to be informed of the research conducted on their behaviour (and be clearly given the option to opt-out at any time). Robert and his coworkers add their clauses to the agreement, specifying what kind of analyses they expect in return, the terms of Emily’s consulting tasks within the company, and what information about the game should be considered confidential.

In a nutshell

The general disconnect between academia and industry is real, and it is particularly acute between those who research video games, and those who develop and sell them.

Researchers and developers can find ways to establish meaningful and mutually beneficial industry-academia collaborations. A degree of negotiation and compromising may be needed, and the terms of the collaboration can be formalised in simple, easily drafted agreements inspired by the principles of Open Science.

Resources

  • The Open Science Framework provides free and open source project management support for researchers. As suggested in the scenarios, it can assist developers and academics in establishing  a common platform and collaboration.
  • Several video game publishers are interested in research, but this is exclusively (narrowly) marketing research.


Suggest a resource for this Scenario

Resources may include readings (books, scientific articles and news), blogs, interesting games, videos...

Latest tweets

@gaming_horizons

Reframing ethics in gaming R&D: beyond compliance

“You can only do that if you go beyond compliance. So it is not just ticking the box […] but to think […] about how we can be responsible and mainstream Social Sciences and Humanities meaningfully, not just as a cherry (on the cake) or an add-on stuff” – quote from an interview with a policy maker.  P14

Description

The notion of what is ethical in research and development is currently rather limited. Our own work focused on gaming and gamification in the European context, but the implications are broader. We talked to many experts and carried out an in-depth analysis of how research and development are framed as priorities in the European flagship funding programme: Horizon 2020. We found that ethics in R&D are almost exclusively focused on compliance, where compliance refers to the need to abide by ethical requirements and conditions. These requirements and conditions are concerned exclusively with the process of research, for instance in terms of ensuring informed consent or equal gender representation in R&D teams, rather than with its outcomes, or with the design principles that inform the process from the outset.

In this scenario, we describe a situation in which a more complex, nuanced and positive idea of ethics informs the design and development of video games.  Rather than being narrowly framed as a collection of requirements that may constrain innovation and creativity, ethics becomes a positive mindset that puts the entire R&D process in a different light. Ethics, in other words, becomes synonymous with aspirations for social and cultural relevance – something aligned with the humanistic, democratic and egalitarian values that underpin the European project. In this alternative scenario (and in its ‘child’ scenarios), policy makers, developers and researchers also begin to challenge strict accountability criteria that revolve exclusively around utilitarian goals and measurable outcomes. Alternative definitions of cultural and technological value, this time more negotiated and dialogic, begin to be explored.  

Meet Michel (an EU policy maker), Simone (a social researcher), and Rita (a game developer)

Michel, Simone and Rita have been invited to an international round table to discuss the future of the gaming industry in Europe. The event is sponsored by the EU Commission and the focus is, predominantly, on the role of institutional support and public funding. The EU Commission is worried that its R&D strategies are beginning to be out of touch with the concerns and priorities of the various EU publics. Games are viewed as a profoundly ‘social’ and pervasive technology and they receive a significant amount of funding. As such, they are an area where concerns for cultural relevance and impact are particularly pressing.

The event provides an interdisciplinary forum to discuss games ‘for good’, which therefore have a distinctly ethical dimension. The event also provides concrete opportunities to examine examples of best practice, focusing on the experiences of developers (and users too) whose games don’t fit into pre-existing categories such as ‘serious’ or ‘educational’ but still have recognisable cultural and educational value, and at the same time manage to operate in the market conditions of the leisure-oriented gaming industry. 

During the event, Michel, Simone, and Rita begin to outline a number of alternative cultural dimensions associated with games: narrative poignancy, appropriate representation, responsible usage, and so forth. They also begin to explore alternative ways to evaluate the cultural and social impact of games. One approach is forming citizen panels collectively recruited through social media; these examine, through a form of ‘crowd-sourced’ evaluation, the social of cultural impact of games developed under the patronage of the EU Commission.

In a nutshell

Ethics in research and development are often viewed as a restrictive set of requirements simply to be complied with. In our project, we often came across this limited interpretation, but we also saw signs of a different position where ethics are part of a more positive mindset, and where notions of what is good, decent, and worth pursuing are grounded in the priorities and concerns of society.  

Funders and key institutional actors like the EU Commission could make more efforts to establish platforms  (including face to face events and social media initiatives) to explore definitions of responsible research and innovation in a dialogic and democratic fashion.

Resources

Our own analysis of EU Funding offers a critical perspective on how ethics and social responsibility are accounted for in the flagship EU R&D programme: https://www.gaminghorizons.eu/wp-content/uploads/sites/18/2017/05/D2.2_critical-analysis-of-H2020-sources.pdf    


Suggest a resource for this Scenario

Resources may include readings (books, scientific articles and news), blogs, interesting games, videos...

Latest tweets

@gaming_horizons