Phenomenon-based Research in Management and Organisation Science: When is it Rigorous and Does it Matter?
Introduction
Recently, several scholars have criticised the strong devotion to theory that they believe characterises management and organisation science (Hambrick, 2007; Helfat, 2007; Miller, 2007). Hambrick noted that too strong a focus on theory is likely to “prevent the reporting of rich details about interesting phenomena for which no theory yet exists” (Hambrick, 2007:1346). Phenomena can be defined as regularities that are unexpected, that challenge existing knowledge (including the extant theory) and that are relevant to scientific discourse. Thus, the aim of phenomenon-based research is to capture, describe and document, as well as conceptualise, a phenomenon so that appropriate theorising and the development of research designs can proceed.
Although it has often been forgotten in the current debate on epistemology in our discipline, phenomenon-based research has a long tradition in management and organisation science. As for well-known research on relevant phenomena, Bartlett and Ghoshal's work (1989) on transnational corporations was phenomenon-driven in the sense that the authors claim explicitly to have begun their process of inquiry by observing interesting phenomena and then identifying and describing their salient aspects. Bartlett and Ghoshal (2002) acknowledge that they do not believe “the transnational corporation really came out of any… literature” (p. 13) and have described their research as an act of hypothesis creation rather than of hypothesis testing. Acknowledging the great importance of Bartlett and Ghoshal's work to international management, Cheng (2007) noted that the phenomenon-motivated research of the former has yielded breakthrough knowledge and new theory (p. 29). Similarly, Lavie (2006) identified a phenomenon-driven approach in the rapidly evolving literature on alliance formation that had stemmed from the accumulation, proliferation and significance of interfirm alliances in recent years (p. 638). Cheng observes that traditional views of the firm such as the resource-based theory have limited explanatory power in accounting for the strategic behaviour and performance of connected firms and suggests the need to integrate and extend them, adopting an overtly interdisciplinary approach. An additional example, the phenomenon of emergent strategy, led Mintzberg and colleagues to spend many years studying the patterns that were visible in streams of management decisions (Mintzberg, 1978; Mintzberg and Waters, 1985), and their work has profoundly influenced the field of strategic management.
Although expectations regarding the outcomes of phenomenon-based research are high, there have been few systematic analyses of possible strategies for ensuring that the rigour of this type of research matches that of other unorthodox research strategies.2 What characterises such strategies? Prior work has suggested that researchers need to formulate broad, open-ended research problems that are framed in “terms of the importance of the phenomenon and of the lack of plausible existing theory” (Eisenhardt and Graebner, 2007, p. 26). Because the researcher has no way of knowing what puzzling issues may emerge from observations, a priori hypothesising regarding specific relationships among the variables may prevent the proper identification of the problem. Edmondson and McManus (2007) suggested that qualitative approaches should be used to address topics about which little or no previous theory exists because such topics concern new phenomena (p. 1161). However, as the editors of LRP suggested in a recent article (Baden-Fuller et al., 2008), there is room for systematic work on the research strategies that can be used in phenomenon-based research. This paper aims to close this gap in the literature by presenting a five-step framework for conducting such research. We illustrate the framework using the case of a prominent technological and social phenomenon: that of open source software (OSS).
In recent years, management and organisation science have been heavily influenced by the emergence of several new phenomena that have attracted scholarly interest. Failures in corporate governance, the environmental impact of firm-level conduct, the rapid diffusion of social networking and social entrepreneurship are examples of such phenomena. However, OSS has characteristics that make it an ideal illustrative example of the phenomena explored in phenomenon-based research. First, OSS is a wide-ranging phenomenon that affects many actors, including individuals, firms and public institutions in such diverse areas as education, science, business and public administration. Moreover, because of this widespread impact, many scholars and practitioners are likely to be familiar with OSS. Second, OSS has a long history as a social movement that began in the 1970s, and has progressively evolved into a more commercially viable product (Fitzgerald, 2006). During the last decade, OSS attracted such unremitting scholarly interest that scientific research has been able to characterise its evolution and social dynamics appropriately. Consequently, we can use OSS to document how phenomena emerge as objects of study in the social sciences. Third, the OSS case allows us to illustrate all five steps of the strategy we propose for conducting phenomenon-based research. As will be shown in greater detail, the scientific exploration of the OSS phenomenon was coupled with the continuous emergence of new puzzling issues. These issues engendered a wide variety of research problems that were investigated using diverse research methods. At every point in time, it was possible to document the existence of OSS-related research issues with scholarly investigations that were still in their infancy or other issues on which mature research had already been produced. Finally, OSS is a multifaceted phenomenon that includes components that are of interest in various scientific disciplines. Our account of the study of OSS may make it easier to apply the research strategy and lessons learned from OSS to new multifaceted phenomena.
Phenomenon-based research is of great interest and importance for several reasons. In the social sciences, as in science, new phenomena that require explanation are continually appearing. The resulting research problems stimulate investigations that are interesting in their own right, rather than being mere opportunities for theory testing (Hacking, 1983; Simonson et al., 2001). Phenomenon-based research supports a general tendency on the part of the top-tier journals in our field (e.g., Academy of Management Journal, MIS Quarterly or Organization Science) to publish research that is relevant (Vermeulen, 2007; Fendt et al., 2008) and interesting (Bartunek et al., 2007) and that has a significant impact on managerial decisions (Pfeffer, 2007).
Phenomenon-based research represents an important early phase in scientific inquiry. In seeking to account for complex phenomena, researchers avoid beginning their analyses with the a priori formulation of hypotheses. No currently available theory has sufficient scope to account for the phenomenon or the relevant cause-and-effect relationships associated with it, and no research design or methodology is considered superior to others as a means of exploring different aspects of the phenomenon. Initial studies generate insights based on exploratory work, yielding data and research strategies that inform subsequent research. Therefore, the lack of appropriate theory generates attempts to make sense of preliminary results and data. A long period of observation of the phenomenon must often transpire before theorising can proceed. Observing phenomena creates new research problems and constructs that later form the foundation for the development of new theories (see Colquitt and Zapata-Phelan, 2007). This mode of scientific inquiry may generate breakthrough knowledge that reshapes the scientific discourse in management and organisation science.
Furthermore, phenomenon-based research promises to help researchers to overcome the relevance-rigour divide that has been much debated in management and organisation science (Kharuna, 2007; Davies, 2006). Straub and Ang (2008) suggest two causes for this divide. First, researchers have been unable or unwilling to transform academic knowledge into actionable, pragmatic knowledge that is useful to practitioners. Second, strong adherence to established theories has made researchers inept at uncovering problems that are of interest to practitioners or at developing solutions to those problems (Hambrick, 2007: 1346). Rynes observed that publication policies that favour theory development and testing create a lack of incentive for academic researchers to study “important or emerging phenomena that cannot be linked to the current theoretical frameworks” (Rynes, 2007: 1380; see also Raelin, 2007; Vermuelen, 2007). Nevertheless, phenomena rank highest in terms of practitioner interests. As early as 1993, Daft and Lewin observed that “the cataclysmic changes occurring in the environment of organisations call for research that does not presume to test normal science hypotheses” (Daft and Lewin, 1993: ii). To help managers succeed in a continually evolving and complex world, Daft and Lewin proposed that scholars begin searching for and investigating important phenomena.3
This paper is organised as follows. In the next section, we characterise phenomena and phenomenon-based research in management and organisation. In Section 3, we propose a strategy for researching phenomena, which we illustrate with research on the phenomenon of OSS. Finally, we discuss the implications of our work and conclude.
Section snippets
Characterising phenomena and phenomenon-based research in management and organisation science
The Compact Oxford English Dictionary of Current English, (2008) presents a broad definition of phenomena: a phenomenon is “a particular (kind of) fact, occurrence, or change as perceived through the senses or known intellectually; especially, a fact or occurrence the cause or explanation of which is in question.”4
A strategy for phenomenon-based research
The academic research on the OSS phenomenon can be used to develop a research strategy with specific activities and goals that can help researchers to conduct rigorous and relevant research on phenomena. Traditionally, knowledge creation in management and organisation science begins with theory formulation, which is followed by the development, implementation, testing and analysis of models. These activities help researchers identify implications and remaining questions. Before this “normal
Conclusions and implications for future research
The target of phenomenon-based research is the early capture of a phenomenon for theoretical work and the development of effective research designs. However, this approach is a forgotten step in management and organisation science. Although important contributions to our discipline began here, many authors claim that we have become theory-driven and thus tend to forget how to view a phenomenon in its totality. Phenomenon-based research can never replace traditional theory-building and testing,
Georg von Krogh is a professor at ETH Zurich where he holds the Chair of Strategic Management and Innovation. Georg specialises in competitive strategy, technological innovation and knowledge management. He is a senior editor for Organization Studies and an editorial board member of a number of journals. [email protected]
References (137)
- et al.
The transnational and beyond: reflection and perspectives at the millennium
- et al.
Firms' involvement in open source projects: a trade-off between software quality and success
Journal of Systems and Software
(2011) - et al.
From planning to mature: on the success of open source projects
Research Policy
(2007) - et al.
How do firms make use of open source communities?
Long Range Planning
(2008) - et al.
Empirical issues in open source software
Information Economics and Policy
(2008) - et al.
The allocation of collaborative efforts in open-source software
Information Economics and Policy
(2008) - et al.
Explaining leadership in virtual teams: the case of open source software
Information Economics and Policy
(2008) - et al.
Profiting from voluntary information spillovers: how users benefit by freely revealing their innovations
Research Policy
(2003) - et al.
Motivation of software developers in open source projects: an internet-based survey of contributors to the linux kernel
Research Policy
(2003) - et al.
How open source software works: “free” user-to-user assistance
Research Policy
(2003)
Putting a Value on Openness: the Effect of Product Source Code Releases on the Market Value of Firms
On the meaning and the epistemological relevance of the notion of a scientific phenomenon
Synthese
Competing technologies, increasing returns and lock-in by historical events
Economic Journal
Call for Phenomenon Based Research
The architecture of participation: does code architecture mitigate free riding in the open source development model?
Management Science
Managing Across Borders: The Transnational Solution
What make management research interesting and why does it matter
Academy of Management Journal
Coase's penguin, or, linux and the nature of the firm
Yale Law Journal
Sharing, Trading, Creating Culture
Science
The dominant logic: retrospective and extension
Strategic Management Journal
A formal theory of differentiation in organizations
American Sociological Review
Saving the phenomena
The Philosophical Review
Entry strategies under dominant standards. Hybrid business models in the Open Source software industry
Management Science
Homo Academicus
Normal science, paradigms, metaphors, discourses and genealogies of analysis
Sociological Paradigms and Organisational Analysis
Challenging dominant physics paradigms
Journal of Scientific Exploration
Becoming Critical: Education, Knowledge, and Action
Critical issues in international management research: an agenda for future advancement
European Journal of International Management
The Design of Inquiring Systems
The hierarchy of the sciences?
American Journal of Sociology
Making Science: Between Nature and Society
Trends in theory testing: a five-decade study of the Academy of Management Journal
Academy of Management Journal
The Positive Philosophy of Auguste Comte
Grounded theory research: procedures, canons, and evaluative criteria
Qualitative Sociology
Invisible Colleges. Diffusion of Knowledge in Scientific Communities
Message equivocality, media selection, and manager performance: implications for information systems
MIS Quarterly
Can organization studies begin to break out the normal science straitjacket? An editorial essay
Organization Science
Where are the theories for the “new” organizational forms? An editorial essay
Organisation Science
Perspective—rigor and relevance in organization studies: idea migration and academic journal evolution
Organization Science
Penguin in a new suit: a tale of how de novo entrants emerged to harness Free and Open Source communities
Industrial and Corporate Change
SimCode: Agent-based Simulation Modelling of Open-Source Software Development
Toward a new economics of science
Research Policy
Dynamics of innovation in an “open source” collaboration environment: lurking, laboring, and launching FLOSS projects on SourceForge
Industrial and Corporate Change
Improving the relevance of management research: evidence-based management: design science or both
Business and Leadership Review
Keep it Simple: A Companion for Simple Wikipedia?
Industry and Innovation
Methodological fit in management and research field
Academy of Management Review
Cited by (215)
Sustainability action in the real estate sector — An organizational and institutional perspective
2023, Cleaner Production LettersExploring the factors, affordances and constraints outlining the implementation of Artificial Intelligence in public sector organizations
2023, International Journal of Information ManagementTowards a framework for development of crowd logistics: Paving the way for sustainable logistics
2023, Computers and Industrial EngineeringAdoption patterns and performance implications of Smart Maintenance
2023, International Journal of Production EconomicsCOVID-19 and Management Scholarship: Lessons for Conducting Impactful Research
2024, Business and Society
Georg von Krogh is a professor at ETH Zurich where he holds the Chair of Strategic Management and Innovation. Georg specialises in competitive strategy, technological innovation and knowledge management. He is a senior editor for Organization Studies and an editorial board member of a number of journals. [email protected]
Cristina Rossi-Lamastra is assistant professor at Politecnico di Milano, Department of Management Economics and Industrial Engineering. She holds a PhD in Economics of Innovation from Sant'Anna School of Advanced Studies. Her research interests are in the area of Industrial and Innovation Economics. At present, her research activities focus mainly on the analysis of young entrepreneurial ventures operating in high-tech sectors. Her studies in Open Source Software deal mainly with firms' involvement in the movement (business models, incentives, project participation, innovation processes). Cristina has published on these topics in Management Science, R&D Management and Research Policy, among others. [email protected]
Stefan Haefliger works as a researcher and lecturer at the Department of Management, Technology and Economics at ETH Zurich. His research and teaching focuses on co-creation strategies as well as knowledge reuse, creation and design in innovation processes. Stefan serves as an associate editor for Long Range Planning and his research has appeared in Management Science, Research Policy and MIS Quarterly. [email protected]
- 1
The authors would like to thank the editorial team for its extremely helpful feedback on multiple earlier versions of this manuscript. In particular, the authors would like to thank the reviewer with deep insights into the philosophy of science. We also appreciate the constructive comments made by audiences at WU Vienna, AoM, and EURAM. The Swiss National Science Foundation supported this research with grant number 100014_125513.