Endre søk
Begrens søket
1 - 29 of 29
RefereraExporteraLink til resultatlisten
Permanent link
Referera
Referensformat
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Annet format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annet språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf
Treff pr side
  • 5
  • 10
  • 20
  • 50
  • 100
  • 250
Sortering
  • Standard (Relevans)
  • Forfatter A-Ø
  • Forfatter Ø-A
  • Tittel A-Ø
  • Tittel Ø-A
  • Type publikasjon A-Ø
  • Type publikasjon Ø-A
  • Eldste først
  • Nyeste først
  • Skapad (Eldste først)
  • Skapad (Nyeste først)
  • Senast uppdaterad (Eldste først)
  • Senast uppdaterad (Nyeste først)
  • Standard (Relevans)
  • Forfatter A-Ø
  • Forfatter Ø-A
  • Tittel A-Ø
  • Tittel Ø-A
  • Type publikasjon A-Ø
  • Type publikasjon Ø-A
  • Eldste først
  • Nyeste først
  • Skapad (Eldste først)
  • Skapad (Nyeste først)
  • Senast uppdaterad (Eldste først)
  • Senast uppdaterad (Nyeste først)
Merk
Maxantalet träffar du kan exportera från sökgränssnittet är 250. Vid större uttag använd dig av utsökningar.
  • 1.
    Abbaspour Asadollah, Sara
    et al.
    Mälardalens högskola, Akademin för innovation, design och teknik, Inbyggda system.
    Hansson, Hans
    Mälardalens högskola, Akademin för innovation, design och teknik, Inbyggda system.
    Sundmark, Daniel
    Mälardalens högskola, Akademin för innovation, design och teknik, Inbyggda system.
    Eldh, Sigrid
    Ericsson AB, Kista, Sweden.
    Towards Classification of Concurrency Bugs Based on Observable Properties2015Inngår i: Proceedings - 1st International Workshop on Complex Faults and Failures in Large Software Systems, COUFLESS 2015, 2015, 41-47 s.Konferansepaper (Fagfellevurdert)
    Abstract [en]

    In software engineering, classification is a way to find an organized structure of knowledge about objects. Classification serves to investigate the relationship between the items to be classified, and can be used to identify the current gaps in the field. In many cases users are able to order and relate objects by fitting them in a category. This paper presents initial work on a taxonomy for classification of errors (bugs) related to concurrent execution of application level software threads. By classifying concurrency bugs based on their corresponding observable properties, this research aims to examine and structure the state of the art in this field, as well as to provide practitioner support for testing and debugging of concurrent software. We also show how the proposed classification, and the different classes of bugs, relates to the state of the art in the field by providing a mapping of the classification to a number of recently published papers in the software engineering field.

  • 2.
    Abbaspour Asadollah, Sara
    et al.
    Mälardalens högskola, Akademin för innovation, design och teknik, Inbyggda system.
    Saadatmand, Mehrdad
    SICS Swedish ICT, Västerås, Sweden.
    Eldh, Sigrid
    Ericsson AB, Kista, Sweden.
    Sundmark, Daniel
    Mälardalens högskola, Akademin för innovation, design och teknik, Inbyggda system.
    Hansson, Hans
    Mälardalens högskola, Akademin för innovation, design och teknik, Inbyggda system.
    A Model for Systematic Monitoring and Debugging of Starvation Bugs in Multicore Software2016Inngår i: 2016 ASE Workshop on Specification, Comprehension, Testing and Debugging of Concurrent Programs SCTDCP2016, 2016Konferansepaper (Fagfellevurdert)
    Abstract [en]

    With the development of multicore hardware, concurrent, parallel and multicore software are becoming increasingly popular. Software companies are spending a huge amount of time and resources to nd and debug the bugs. Among all types of software bugs, concurrency bugs are also important and troublesome. This type of bugs is increasingly becoming an issue particularly due to the growing prevalence of multicore hardware. In this position paper, we propose a model for monitoring and debugging Starvation bugs as a type of concurrency bugs in multicore software. The model is composed into three phases: monitoring, detecting and debugging. The monitoring phase can support detecting phase by storing collected data from the system execution. The detecting phase can support debugging phase by comparing the stored data with starvation bug's properties, and the debugging phase can help in reproducing and removing the Starvation bug from multicore software. Our intention is that our model is the basis for developing tool(s) to enable solving Starvation bugs in software for multicore platforms.

  • 3.
    Abbaspour Asadollah, Sara
    et al.
    Mälardalens högskola, Akademin för innovation, design och teknik, Inbyggda system.
    Sundmark, Daniel
    Mälardalens högskola, Akademin för innovation, design och teknik, Inbyggda system.
    Eldh, Sigrid
    Ericsson AB, Kista, Sweden .
    Hansson, Hans
    Mälardalens högskola, Akademin för innovation, design och teknik, Inbyggda system.
    Afza, Wasif
    Mälardalens högskola, Akademin för innovation, design och teknik, Inbyggda system.
    10 Years of research on debugging concurrent and multicore software: a systematic mapping studyInngår i: Software quality journal, ISSN 0963-9314, E-ISSN 1573-1367Artikkel i tidsskrift (Fagfellevurdert)
    Abstract [en]

    Debugging – the process of identifying, localizing and fixing bugs – is a key activity in software development. Due to issues such as non-determinism and difficulties of reproducing failures, debugging concurrent software is significantly more challenging than debugging sequential software. A number of methods, models and tools for debugging concurrent and multicore software have been proposed, but the body of work partially lacks a common terminology and a more recent view of the problems to solve. This suggests the need for a classification, and an up-to-date comprehensive overview of the area. 

    This paper presents the results of a systematic mapping study in the field of debugging of concurrent and multicore software in the last decade (2005– 2014). The study is guided by two objectives: (1) to summarize the recent publication trends and (2) to clarify current research gaps in the field.

    Through a multi-stage selection process, we identified 145 relevant papers. Based on these, we summarize the publication trend in the field by showing distribution of publications with respect to year , publication venues , representation of academia and industry , and active research institutes . We also identify research gaps in the field based on attributes such as types of concurrency bugs, types of debugging processes , types of research  and research contributions.

    The main observations from the study are that during the years 2005–2014: (1) there is no focal conference or venue to publish papers in this area, hence a large variety of conferences and journal venues (90) are used to publish relevant papers in this area; (2) in terms of publication contribution, academia was more active in this area than industry; (3) most publications in the field address the data race bug; (4) bug identification is the most common stage of debugging addressed by articles in the period; (5) there are six types of research approaches found, with solution proposals being the most common one; and (6) the published papers essentially focus on four different types of contributions, with ”methods” being the type most common one.

    We can further conclude that there is still quite a number of aspects that are not sufficiently covered in the field, most notably including (1) exploring correction  and fixing bugs  in terms of debugging process; (2) order violation, suspension  and starvation  in terms of concurrency bugs; (3) validation and evaluation research  in the matter of research type; (4) metric  in terms of research contribution. It is clear that the concurrent, parallel and multicore software community needs broader studies in debugging.This systematic mapping study can help direct such efforts.

  • 4.
    Abbaspour Asadollah, Sara
    et al.
    Mälardalens högskola, Akademin för innovation, design och teknik, Inbyggda system.
    Sundmark, Daniel
    Mälardalens högskola, Akademin för innovation, design och teknik, Inbyggda system.
    Eldh, Sigrid
    Ericsson AB, Kista, Sweden.
    Hansson, Hans
    Mälardalens högskola, Akademin för innovation, design och teknik, Inbyggda system.
    Paul Enoiu, Eduard
    Mälardalens högskola, Akademin för innovation, design och teknik, Inbyggda system.
    A Study on Concurrency Bugs in an Open Source Software2016Inngår i: IFIP Advances in Information and Communication Technology, vol. 472, 2016, Vol. 472, 16-31 s.Konferansepaper (Fagfellevurdert)
    Abstract [en]

    Concurrent programming puts demands on software debugging and testing, as concurrent software may exhibit problems not present in sequential software, e.g., deadlocks and race conditions. In aiming to increase efficiency and effectiveness of debugging and bug-fixing for concurrent software, a deep understanding of concurrency bugs, their frequency and fixingtimes would be helpful. Similarly, to design effective tools and techniques for testing and debugging concurrent software understanding the differences between non-concurrency and concurrency bugs in real-word software would be useful.

  • 5.
    Doganay, Kivanc
    et al.
    Mälardalens högskola, Akademin för innovation, design och teknik, Inbyggda system.
    Eldh, Sigrid
    Ericsson AB, Kista, Sweden.
    Afzal, Wasif
    Mälardalens högskola, Akademin för innovation, design och teknik, Inbyggda system.
    Bohlin, Markus
    Mälardalens högskola, Akademin för innovation, design och teknik, Inbyggda system.
    Search-based Testing for Embedded Telecommunication Software with Complex Input Structures: An Industrial Case Study2014Rapport (Annet vitenskapelig)
    Abstract [en]

    In this paper, we discuss the application of search-based software test-ing techniques for unit level testing of a real-world telecommunication middleware at Ericsson. Input data for the system under test consists of nested data structures, and includes non-trivial variables such as unini-tialized pointers. Our current implementation analyzes the existing test cases to discover how to handle pointers, set global system parameters, and any other setup code that needs to run before the actual test case. Hill climbing (HC) and (1+1) evolutionary algorithm (EA) metaheuristic search algorithms are used to generate input data for branch coverage. We compare HC, (1+1)EA, and random search as a baseline of performance with respect to e˙ectiveness, measured as branch coverage, and eÿciency, measured as number of executions needed. Diÿculties arising from the specialized execution environment and the adaptations for handling these problems are also discussed.

  • 6.
    Eldh, Sigrid
    Mälardalens högskola, Institutionen för datavetenskap och elektronik.
    How to Save on Quality Assurance – Challenges in Software Testing2006Inngår i: Jornadas sobre Testeo de SoftwareArtikkel i tidsskrift (Fagfellevurdert)
  • 7.
    Eldh, Sigrid
    Mälardalens högskola, Institutionen för datavetenskap och elektronik.
    How to save on quality assurance challenges in software testing2006Konferansepaper (Fagfellevurdert)
    Abstract [en]

    Quality assurance, and in particular software testing and verification, are areas that yet have much to offer to the industry. Companies that develop software need to improve their skills in this area to get the best return on investments. Important future strategies for survival are to collaborate with academia to find solutions to several difficult problems within software testing. Some of the areas and experiences in software testing that needs to be improved from an industry perspective is discussed, like test automation and component test. We have created a way to improve designers testing, which we call software quality rank. This ranking system takes known research results, including knowledge and tools from static- and run-time analysis and making them work in industry. The software quality rank aims to improve testing on the component level. We have saved a lot of money by improving the test area, and we share some of the lessons learned to aid other businesses with the same endeavor.

  • 8.
    Eldh, Sigrid
    Mälardalens högskola, Institutionen för datavetenskap och elektronik.
    On Evaluating Test Techniques in an Industrial Setting2007Licentiatavhandling, med artikler (Annet vitenskapelig)
    Abstract [en]

    Testing is a costly and an important activity in the software industry today. The systems are becoming more complex and the amount of code is constantly increasing. The majority of systems need to rely on its testing to show that it works, is reliable, and performs according to user expectations and specifications.

    Testing is performed in a multitude of ways, using different test approaches. How testing is conducted becomes essential, when time is limited, since exhaustive testing is not an option in large complex systems, Therefore, the design of the individual test case – and what part and aspect of the system it exercises, is the main focus of testing. Not only do we need to create, and execute test cases efficiently, but we also want them to expose important faults in the system. This main topic of testing has long been a focus of practitioners in industry, and there exists over 70 test techniques that aim to describe how to design a test case. Unfortunately, despite the industrial needs, research on test techniques are seldom performed in large complex systems.

    The main purpose of this licentiate thesis is to create an environment and framework where it is possible to evaluate test techniques. Our overall goal is to investigate suitable test techniques for different levels, (e.g. component, integration and system level) and to provide guidelines to industry on what is effective, efficient and applicable to test, based on knowledge of failure-fault distribution in a particular domain. In this thesis, our research has been described through four papers that start from a broad overview of typical industrial systems and arrive at a specific focus on how to set up a controlled experiment in an industrial environment. Our initial paper has stated the status of testing in industry, and aided in identifying specific issues as well as underlined the need for further research. We then made experiments with component test improvements, by simple utilization of known approaches (e.g. static analysis, code reviews and statement coverage). This resulted in a substantial cost-reduction and increased quality, and provided us better understanding of the difficulties in deploying known test techniques in reality, which are described in our second paper. These works lead us to our third paper, which describes the framework and process for evaluating test techniques. The first sub-process in this framework deals with how to prepare the experiment with a known set of faults. We aimed to investigate fault classifications to get a useful set of faults of different types to inject. In addition, we investigated real faults reported in an industrial system, performed controlled experiments, and the results were published in our fourth paper.

    The main contributions of this Licentiate thesis are the valuable insights in the context of evaluation of test techniques, specifically the problems of creating a useful experiment in an industrial setting, in addition to the survey of the state of practice of software testing in Industry. We want to better understand what needs to be done to create efficient evaluations of test techniques, and secondly what is the relation between faults/failures and test techniques. Though our experiments have not yet been able to create ‘the ultimate’ classification for such an aim, the results indicate the appropriateness of this approach. With these valuable insights, we believe that we will be able to direct our future research, to make better evaluations that have a larger potential to generalize and scale.

  • 9.
    Eldh, Sigrid
    Mälardalens högskola, Akademin för innovation, design och teknik.
    On Test Design2011Doktoravhandling, monografi (Annet vitenskapelig)
    Abstract [en]

    Testing is the dominating method for quality assurance of industrial software. Despite its importance and the vast amount of resources invested, there are surprisingly limited efforts spent on testing research, and the few industrially applicable results that emerge are rarely adopted by industry. At the same time, the software industry is in dire need of better support for testing its software within the limited time available.

    Our aim is to provide a better understanding of how test cases are created and applied, and what factors really impact the quality of the actual test. The plethora of test design techniques (TDTs) available makes decisions on how to test a difficult choice. Which techniques should be chosen and where in the software should they be applied? Are there any particular benefits of using a specific TDT? Which techniques are effective? Which can you automate? What is the most beneficial way to do a systematic test of a system?

    This thesis attempts to answer some of these questions by providing a set of guidelines for test design, including concrete suggestions for how to improve testing of industrial software systems, thereby contributing to an improved overall system quality. The guidelines are based on ten studies on the understanding and use of TDTs. The studies have been performed in a variety of system domains and consider several different aspects of software test. For example, we have investigated some of the common mistakes in creating test cases that can lead to poor and costly testing. We have also compared the effectiveness of different TDTs for different types of systems. One of the key factors for these comparisons is a profound understanding of faults and their propagation in different systems. Furthermore, we introduce a taxonomy for TDTs based on their effectiveness (fault finding ability), efficiency (fault finding rate), and applicability. Our goal is to provide an improved basis for making well-founded decisions regarding software testing, together with a better understanding of the complex process of test design and test case writing. Our guidelines are expected to lead to improvements in testing of complex industrial software, as well as to higher product quality and shorter time to market.

  • 10.
    Eldh, Sigrid
    et al.
    Mälardalens högskola, Akademin för innovation, design och teknik.
    Brandt, Joachim
    Ericsson Ltd.
    Street, Mark
    Ericsson Ltd.
    Hansson, Hans
    Mälardalens högskola, Akademin för innovation, design och teknik.
    Punnekkat, Sasikumar
    Mälardalens högskola, Akademin för innovation, design och teknik.
    Towards Fully Automated Test Management for Large Complex Systems2010Inngår i: ICST 2010 - 3rd International Conference on Software Testing, Verification and Validation, Paris, 2010, 412-420 s.Konferansepaper (Fagfellevurdert)
    Abstract [en]

    Development of large and complex software intensive systems with continuous builds typically generates large volumes of information with complex patterns and relations. Systematic and automated approaches are needed for efficient handling of such large quantities of data in a comprehensible way. In this paper we present an approach and tool enabling autonomous behavior in an automated test management tool to gain efficiency in concurrent software development and test. By capturing the required quality criteria in the test specifications and automating the test execution, test management can potentially be performed to a great extent without manual intervention. This work contributes towards a more autonomous behavior within a distributed remote test strategy based on metrics for decision making in automated testing. These metrics optimize management of fault corrections and retest, giving consideration to the impact of the identified weaknesses, such as fault-prone areas in software.

  • 11.
    Eldh, Sigrid
    et al.
    Mälardalens högskola, Akademin för innovation, design och teknik.
    Hansson, Hans
    Mälardalens högskola, Akademin för innovation, design och teknik.
    Punnekkat, Sasikumar
    Mälardalens högskola, Akademin för innovation, design och teknik.
    Analysis of Mistakes as a Method to Improve Test Case Design2011Inngår i: International Conference on Software Testing, Verification and Validation(ICST), Berlin, 2011, 70-79 s.Konferansepaper (Fagfellevurdert)
    Abstract [en]

    Test Design - how test specifications and test cases are created - inherently determines the success of testing. However, test design techniques are not always properly applied, leading to poor testing. We have developed an analysis method based on identifying mistakes made when designing the test cases. Using an extended test case template and an expert review, the method provides a systematic categorization of mistakes in the test design. The two main classes of identified mistakes are (1) lack of comprehension (of the employed test design technique, target of test etc.) and (2) incomplete test case construction (due to lack of detail, missing clean-up, ambiguities, etc.). The detailed categorization of mistakes provides a basis for improvement of the Test Case Design, resulting in better tests. In developing our method we have investigated over 700 test cases created by novice testers. In a comparison with industrial test cases we could confirm that many of our mistake categories remain relevant also in an industrial context. Our contribution is a new method to improve the effectiveness of test case construction through proper application of test design techniques, leading to an improved coverage without loss of efficiency.

  • 12.
    Eldh, Sigrid
    et al.
    Mälardalens högskola, Institutionen för datavetenskap och elektronik.
    Hansson, Hans
    Mälardalens högskola, Institutionen för datavetenskap och elektronik.
    Punnekkat, Sasikumar
    Mälardalens högskola, Institutionen för datavetenskap och elektronik.
    Pettersson, Anders
    Mälardalens högskola, Institutionen för datavetenskap och elektronik.
    Sundmark, Daniel
    Mälardalens högskola, Institutionen för datavetenskap och elektronik.
    Framework for Comparing Efficiency, Effectiveness and Applicability of Software Testing Techniques2006Inngår i: Proceedings - Testing: Academic and Industrial Conference - Practice and Research Techniques, TAIC PART 2006, 2006, 159-170 s., 1691683Konferansepaper (Fagfellevurdert)
    Abstract [en]

    Software testing is expensive for the industry, and always constrained by time and effort. Although there is a multitude of test techniques, there are currently no scientifically based guidelines for the selection of appropriate techniques of different domains and contexts. For large complex systems, some techniques are more efficient in finding failures than others and some are easier to apply than others are. From an industrial perspective, it is important to find the most effective and efficient test design technique that is possible to automate and apply. In this paper, we propose an experimental framework for comparison of test techniques with respect to efficiency, effectiveness and applicability. We also plan to evaluate ease of automation, which has not been addressed by previous studies. We highlight some of the problems of evaluating or comparingtest techniques in an objective manner. We describe our planned process for this multi-phase experimental study. This includes presentation of some of the important measurements to be collected with the dual goals of analyzing the properties of the test technique, as well as validating our experimental framework.

  • 13.
    Eldh, Sigrid
    et al.
    Mälardalens högskola, Akademin för innovation, design och teknik.
    Punnekkat, Sasikumar
    Mälardalens högskola, Akademin för innovation, design och teknik.
    Synergizing Industrial Needs and Academic Research for Better Software Education2012Inngår i: 2012 1st International Workshop on Software Engineering Education Based on Real-World Experiences, EduRex 2012 - Proceedings, 2012, 33-36 s.Konferansepaper (Fagfellevurdert)
    Abstract [en]

    The ubiquity of software is making every industry increasingly dependent on it for achieving their core products' functionality. The complexity in a telecommunication network requires not only thorough understanding of telecommunication per se, but software becomes equally interesting. This is the case with many industries, which rely more and more on software as their key enabler. Industry definitely needs a large number of software engineers with potential to be productive from day one. They are feeling impatient at the academic community for not being pragmatic. At the same time Academic community faces many challenges, which often make them thread a traditional path thus ignoring the industrial needs. We present some of these challenges from both the industrial and academic perspectives. We also present how we established a Master level advanced course on software verification and validation through mutual support and collaboration which became highly successful.

  • 14.
    Eldh, Sigrid
    et al.
    Mälardalens högskola, Institutionen för datavetenskap och elektronik.
    Punnekkat, Sasikumar
    Hansson, Hans
    Experiments with Component Test to Improve Software QualityManuskript (preprint) (Annet vitenskapelig)
  • 15.
    Eldh, Sigrid
    et al.
    Mälardalens högskola, Institutionen för datavetenskap och elektronik.
    Punnekkat, Sasikumar
    Mälardalens högskola, Institutionen för datavetenskap och elektronik.
    Hansson, Hans
    Mälardalens högskola, Institutionen för datavetenskap och elektronik.
    Experiments with Component Tests to Improve Software Quality2007Konferansepaper (Fagfellevurdert)
    Abstract [en]

    In commercial systems, time to market pressure often result in short cuts in the design phase where component test is most vulnerable. It is hard to define how much testing is cost effective by the individual developers, and hard to judge when testing is enough. Verification activities constitute a major part of the product cost. Failures unearthed during later phases of product development escalate the cost substantially. To reduce cost in later stages of testing by reducing failures is important not only for Ericsson, but for any software producer. At Ericsson, we created a scheme, Software Quality Rank (SQR). SQR is a way to improve quality on components. SQR consists of five steps, where the first is where the actual "ranking" of components takes place. Then a selection of components is targeted for improvement in five levels. Most components are targeted for rank 3, which is the cost-efficient quality level. Rank 5 is the target for safety-critical code. The goal of SQR was to provide developers with a tool that prioritizes what to do before delivery to next system test phase. SQR defines a stepwise plan, which describes how much and what to test on component level for each rank. It gives the process for how to prioritize components; re-introduces reviews; requires usage of static analysis tools and defines what coverage to be achieved. The scheme has been used with great success at different design organizations within and outside Ericsson and we believe it supports industry in defining what cost-efficient component test in a time to market situation.

  • 16.
    Eldh, Sigrid
    et al.
    Mälardalens högskola, Institutionen för datavetenskap och elektronik.
    Punnekkat, Sasikumar
    Mälardalens högskola, Institutionen för datavetenskap och elektronik.
    Hansson, Hans
    Mälardalens högskola, Institutionen för datavetenskap och elektronik.
    Jönsson, Peter
    Mälardalens högskola, Institutionen för datavetenskap och elektronik.
    Component Testing is not Enough - A Study of Software Faults in Telecom Middleware2007Inngår i: Lecture Notes in Computer Science, vol. 4581, 2007, 74-89 s.Konferansepaper (Fagfellevurdert)
    Abstract [en]

    The interrelationship between software faults and failures is quite intricate and obtaining a meaningful characterization of it would definitely help the testing community in deciding on efficient and effective test strategies. Towards this objective, we have investigated and classified failures observed in a large complex telecommunication industry middleware system during 2003- 2006. In this paper, we describe the process used in our study for tracking faults from failures along with the details of failure data. We present the distribution and frequency of the failures along with some interesting findings unravelled while analyzing the origins of these failures. Firstly, though "simple" faults happen, together they account for only less than 10%. The majority of faults come from either missing code or path, or superfluous code, which are all faults that manifest themselves for the first time at integration/system level; not at component level. These faults are more frequent in the early versions of the software, and could very well be attributed to the difficulties in comprehending and specifying the context (and adjacent code) and its dependencies well enough, in a large complex system with time to market pressures. This exposes the limitations of component testing in such complex systems and underlines the need for allocating more resources for higher level integration and system testing.

  • 17.
    Eldh, Sigrid
    et al.
    Mälardalens högskola, Institutionen för datavetenskap och elektronik.
    Punnekkat, Sasikumar
    Mälardalens högskola, Institutionen för datavetenskap och elektronik.
    Hansson, Hans
    Mälardalens högskola, Institutionen för datavetenskap och elektronik.
    Jönsson, Peter
    Combitech., Ericsson AB.
    Component Testing is Not Enough - A Study of Software Faults in Telecom Middleware2007Inngår i: Lecture Notes in Computer Science, vol. 4581, Springer, 2007, 74-89 s.Kapittel i bok, del av antologi (Fagfellevurdert)
    Abstract [en]

    The interrelationship between software faults and failures is quite intricate and obtaining a meaningful characterization of it would definitely help the testing community in deciding on efficient and effective test strategies. Towards this objective, we have investigated and classified failures observed in a large complex telecommunication industry middleware system during 2003-2006. In this paper, we describe the process used in our study for tracking faults from failures along with the details of failure data. We present the distribution and frequency of the failures along with some interesting findings unravelled while analyzing the origins of these failures. Firstly, though "simple" faults happen, together they account for only less than 10%. The majority of faults come from either missing code or path, or superfluous code, which are all faults that manifest themselves for the first time at integration/system level; not at component level. These faults are more frequent in the early versions of the software, and could very well be attributed to the difficulties in comprehending and specifying the context (and adjacent code) and its dependencies well enough, in a large complex system with time to market pressures. This exposes the limitations of component testing in such complex systems and underlines the need for allocating more resources for higher level integration and system testing.

  • 18.
    Eldh, Sigrid
    et al.
    Mälardalens högskola, Akademin för innovation, design och teknik.
    Sundmark, Daniel
    Mälardalens högskola, Akademin för innovation, design och teknik.
    Robustness Testing of Mobile Telecommunication Systems: A Case Study on Industrial Practice and Challenges2012Inngår i: Proceedings - IEEE 5th International Conference on Software Testing, Verification and Validation, ICST 2012, 2012, 895-900 s.Konferansepaper (Fagfellevurdert)
    Abstract [en]

    Context: Robustness relates to the capability of a system to handle internal and external negative situations and disturbances. Robustness testing is the act of subjecting the system under test to such disturbances in a controlled manner. Objective: The objective of this study is to understand how robustness is considered in the development and testing of large-scale telecom systems, to identify the main challenges related to robustness and robustness testing, and to identify potential improvements to the current situation. Method: An exploratory case study of a Swedish telecom company was conducted. Data was collected through inter- views, study of documentation, and participant observation. Results: A number of challenges related to robustness testing was identified. Even though there is a relatively consistent view of robustness within the company, and robustness is considered to be an important quality attribute, there is a lack of explicit focus on robustness in design and requirements analysis. Conclusion: Our conclusion is that the area of robustness test is challenging for large complex systems, where the understanding of how to provoke complex failures and derive a root cause, as well as defining the correct level of robust design in software is not sufficiently explored.

  • 19.
    Hassan, Mohammad Mahdi
    et al.
    Karlstad University, Sweden.
    Afzal, Wasif
    Mälardalens högskola, Akademin för innovation, design och teknik, Inbyggda system.
    Blom, Martin
    Karlstad universitet, Sweden.
    Lindström, Birgitta
    Högskolan i Skövde, Sweden.
    Andler, Sten F.
    Högskolan i Skövde, Sweden.
    Eldh, Sigrid
    Mälardalens högskola, Akademin för innovation, design och teknik, Inbyggda system.
    Testability and Software Robustness: A Systematic Literature Review2015Inngår i: The 41st Euromicro Conference on Software Engineering and Advanced Applications SEAA'15, Funchal, Madeira, Portugal, 2015, 341-348 s.Konferansepaper (Fagfellevurdert)
    Abstract [en]

    The concept of software testability has been researched in several different dimensions, however the relation of this important concept with other quality attributes is a grey area where existing evidence is scattered. The objective of this study is to present a state-of-the-art with respect to issues of importance concerning software testability and an important quality attribute: software robustness. The objective is achieved by conducting a systematic literature review (SLR) on the topic. Our results show that a variety of testability issues are in focus with observability and controllability issues being most researched. Fault tolerance, exception handling and handling external influence are prominent robustness issues in focus.

  • 20.
    Jägemar, Marcus
    et al.
    Ericsson, Stockholm, Sweden.
    Eldh, Sigrid
    Mälardalens högskola, Akademin för innovation, design och teknik, Inbyggda system.
    Ermedahl, Andreas
    Ericsson, Stockholm, Sweden.
    Lisper, Björn
    Mälardalens högskola, Akademin för innovation, design och teknik, Inbyggda system.
    Automatic Message Compression with Overload Protection2016Inngår i: Journal of Systems and Software, ISSN 0164-1212, E-ISSN 1873-1228, Vol. 121, nr 1 nov, 209-222 s.Artikkel i tidsskrift (Fagfellevurdert)
    Abstract [en]

    In this paper, we show that it is possible to increase the message throughput of a large-scale industrial system by selectively compress messages. The demand for new high-performance message processing systems conflicts with the cost effectiveness of legacy systems. The result is often a mixed environment with several concurrent system generations. Such a mixed environment does not allow a complete replacement of the communication backbone to provide the increased messaging performance. Thus, performance-enhancing software solutions are highly attractive. Our contribution is 1) an online compression mechanism that automatically selects the most appropriate compression algorithm to minimize the message round trip time; 2) a compression overload mechanism that ensures ample resources for other processes sharing the same CPU. We have integrated 11 well-known compression algorithms/configurations and tested them with production node traffic. In our target system, automatic message compression results is a 9.6% reduction of message round trip time. The selection procedure is fully automatic and does not require any manual intervention. The automatic behavior makes it particularly suitable for large systems where it is difficult to predict future system behavior.

  • 21.
    Jägemar, Marcus
    et al.
    Mälardalens högskola, Akademin för innovation, design och teknik, Inbyggda system.
    Eldh, Sigrid
    Mälardalens högskola, Akademin för innovation, design och teknik, Inbyggda system.
    Ermedahl, Andreas
    Mälardalens högskola, Akademin för innovation, design och teknik, Inbyggda system.
    Lisper, Björn
    Mälardalens högskola, Akademin för innovation, design och teknik, Inbyggda system.
    Automatic Multi-Core Cache Characteristics Modelling2013Konferansepaper (Fagfellevurdert)
    Abstract [en]

    When updating low-level software for large computer systems it is di cult to verify whether performance requirements are met or not. Common practice is to measure the performance only when the new software is fully developed and has reached system veri cation. Since this gives long lead-times it becomes costly to remedy performance problems. Our contribution is that we have deployed a new method to synthesise production workload. We have, using this method, created a multi-core cache characteristics model. We have validated our method by deploying it in a production system as a case study. The result shows that the method is su ciently accurate to detect changes and mimic cache characteristics and performance, and thus giving early characteristics feedback to engineers.We have also applied the model to a real software update detecting changes in performance characteristics similar to the real system.

  • 22.
    Jägemar, Marcus
    et al.
    Mälardalens högskola, Akademin för innovation, design och teknik.
    Eldh, Sigrid
    Mälardalens högskola, Akademin för innovation, design och teknik.
    Ermedahl, Andreas
    Mälardalens högskola, Akademin för innovation, design och teknik.
    Lisper, Björn
    Mälardalens högskola, Akademin för innovation, design och teknik.
    Feedback-Based Generation of Hardware Characteristics2012Rapport (Annet vitenskapelig)
    Abstract [en]

    In large complex server-like computer systems it is difficult to characterise hardware usage in early stages of system development. Many times the applications running on the platform are not ready at the time of platform deployment leading to postponed metrics measurement. In our study we seek answers to the questions: (1) Can we use a feedback-based control system to create a characteristics model of a real production system? (2) Can such a model be sufficiently accurate to detect characteristics changes instead of executing the production application? The model we have created runs a signalling application, similar to the production application, together with a PID-regulator generating L1 and L2 cache misses to the same extent as the production system. Our measurements indicate that we have managed to mimic a similar environment regarding cache characteristics. Additionally we have applied the model on a software update for a production system and detected characteristics changes using the model. This has later been verified on the complete production system, which in this study is a large scale telecommunication system with a substantial market share.

  • 23.
    Jägemar, Marcus
    et al.
    Ericsson AB.
    Eldh, Sigrid
    Ericsson AB.
    Ermedahl, Andreas
    Ericsson AB.
    Lisper, Björn
    Mälardalens högskola, Akademin för innovation, design och teknik.
    Towards Feedback-Based Generation of Hardware Characteristics2012Inngår i: 7th International Workshop on Feedback Computing, 2012Konferansepaper (Fagfellevurdert)
    Abstract [en]

    In large complex server-like computer systems it is difficult to characterise hardware usage in early stages of system development. Many times the applications running on the platform are not ready at the time of platform deployment leading to postponed metrics measurement. In our study we seek answers to the questions: (1) Can we use a feedback-based control system to create a characteristics model of a real production system? (2) Can such a model be sufficiently accurate to detect characteristics changes instead of executing the production application? The model we have created runs a signalling application, similar to the production application, together with a PID-regulator generating L1 and L2 cache misses to the same extent as the production system. Our measurements indicate that we have managed to mimic a similar environment regarding cache characteristics. Additionally we have applied the model on a software update for a production system and detected characteristics changes using the model. This has later been verified on the complete production system, which in this study is a large scale telecommunication system with a substantial market share.

  • 24.
    Jägemar, Marcus
    et al.
    Mälardalens högskola, Akademin för innovation, design och teknik, Inbyggda system. Ericsson, Stockholm, Sweden.
    Lisper, Björn
    Mälardalens högskola, Akademin för innovation, design och teknik, Inbyggda system.
    Eldh, Sigrid
    Mälardalens högskola, Akademin för innovation, design och teknik, Inbyggda system.
    Ermedahl, Andreas
    Ericsson, Stockholm, Sweden.
    Andai, Gabor
    Automatic Benchmarking for Early-Stage Performance Verification of Industrial Systems2016Manuskript (preprint) (Annet vitenskapelig)
  • 25.
    Marcus, Jägemar
    et al.
    Mälardalens högskola, Akademin för innovation, design och teknik, Inbyggda system.
    Behnam, Moris
    Mälardalens högskola, Akademin för innovation, design och teknik, Inbyggda system.
    Eldh, Sigrid
    Mälardalens högskola, Akademin för innovation, design och teknik, Inbyggda system.
    Ermedahl, Andreas
    A Scheduling Architecture for Enforcing Quality of Service in Multi-Process Systems2017Inngår i: International Conference on Emerging Technologies And Factory Automation ETFA'17, 2017Konferansepaper (Fagfellevurdert)
    Abstract [en]

    There is a massive deployment of multi-core CPUs. It requires a significant drive to consolidate multiple services while still achieving high performance on these off-the-shelf CPUs. Each function had earlier an own execution environment, which guaranteed a certain Quality of Service (QoS). Consolidating multiple services can give rise to shared resource congestions, resulting in lower and non-deterministic QoS. We describe a method to increase the overall system performance by assisting the operating system process scheduler to utilize shared resources more efficiently. Our method utilizes hardware- and system-level performance counters to profile the shared resource usage of each process. We also use a big-data approach to analyzing statistics from many nodes. The outcome of the analysis is a decision support model that is utilized by the process scheduler when allocating and scheduling process. Our scheduler can efficiently distribute processes compared to traditional CPU-load based process schedulers by considering the hardware capacity and previous scheduling- and allocation decisions.

  • 26.
    Wiklund, Kristian
    et al.
    Ericsson AB, Sweden.
    Eldh, Sigrid
    Ericsson AB, Sweden.
    Sundmark, Daniel
    Mälardalens högskola, Akademin för innovation, design och teknik, Inbyggda system.
    Lundqvist, Kristina
    Mälardalens högskola, Akademin för innovation, design och teknik, Inbyggda system.
    Can we do useful industrial software engineering research in the shadow of Lean and Agile?2013Konferansepaper (Fagfellevurdert)
    Abstract [en]

    The software industry is rapidly changing from traditional ways of working to lean and agile development methods using self-organized feature development teams that are performing a much larger part of the development process than before. Face to face communication will replace many of the design artifacts used for work-in-progress, such as defect reports and feature system design specifications. This type of data will cease to exist when the feature is developed or the problem is solved, and will not be readily available to researchers. As a consequence, software engineering research in industry will have to rely primarily on participatory and observational methods.

  • 27. Wiklund, Kristian
    et al.
    Eldh, Sigrid
    Sundmark, Daniel
    Mälardalens högskola, Akademin för innovation, design och teknik.
    Lundqvist, Kristina
    Mälardalens högskola, Akademin för innovation, design och teknik.
    Technical Debt in Test Automation2012Inngår i: Proceedings - IEEE 5th International Conference on Software Testing, Verification and Validation, ICST 2012, IEEE Computer Society, 2012, 887-892 s.Konferansepaper (Fagfellevurdert)
    Abstract [en]

    Automated test execution is one of the more popular and available strategies to minimize the cost for software testing, and is also becoming one of the central concepts in modern software development as methods such as test-driven devel- opment gain popularity. Published studies on test automation indicate that the maintenance and development of test automation tools commonly encounter problems due to unforeseen issues. To further investigate this, we performed a case study on a telecommunication subsystem to seek factors that contribute to inefficiencies in use, maintenance, and development of the automated testing performed within the scope of responsibility of a software design team. A qualitative evaluation of the findings indicates that the main areas of improvement in this case are in the fields of interaction design and general software design principles, as applied to test execution system development.

  • 28.
    Wiklund, Kristian
    et al.
    Mälardalens högskola, Akademin för innovation, design och teknik, Inbyggda system.
    Sundmark, Daniel
    Mälardalens högskola, Akademin för innovation, design och teknik, Inbyggda system.
    Eldh, Sigrid
    Mälardalens högskola, Akademin för innovation, design och teknik, Inbyggda system. Ericsson AB, Sweden.
    Lundqvist, Kristina
    Mälardalens högskola, Akademin för innovation, design och teknik, Inbyggda system.
    Impediments for Automated Testing - An Empirical Analysis of a User Support Discussion Board2014Inngår i: Seventh IEEE International Conference on Software Testing, Verification and Validation ICST 2014, IEEE , 2014, 113-122 s.Konferansepaper (Fagfellevurdert)
    Abstract [en]

    To better understand the challenges encountered by users and developers of automatic software testing, we have performed an empirical investigation of a discussion board used for support of a test automation framework having several hundred users. The messages on the discussion board were stratified into problem reports, help requests, development information, and feature requests. The messages in the problem report and help request strata were then sampled and analyzed using thematic analysis, searching for common patterns. Our analysis indicate that a large part of the impediments discussed on the board are related to issues related to the centralized IT environment, and to erroneous behavior connected to the use of the framework and related components. We also observed a large amount of impediments related to the use of software development tools. Turning to the help requests, we found that the majority of the help requests were about designing test scripts and not about the areas that appear to be most problematic. From our results and previous publications, we see a clear need to simplify the use, installation, and configuration of test systems of this type. The problems attributable to software development tools suggest that testers implementing test automation need more skills in handling those tools, than historically has been assumed. Finally, we propose that further research into the benefits of centralization of tools and IT environments, as well as structured deployment and efficient use of test automation, is performed.

  • 29.
    Wiklund, Kristian
    et al.
    Ericsson AB.
    Sundmark, Daniel
    Mälardalens högskola, Akademin för innovation, design och teknik, Inbyggda system.
    Eldh, Sigrid
    Ericsson AB.
    Lundqvist, Kristina
    Mälardalens högskola, Akademin för innovation, design och teknik, Inbyggda system.
    Impediments in Agile Software Development: An Empirical Investigation2013Inngår i: Product-Focused Software Process Improvement, Lecture Notes in Computer Science Volume 7983: 14th International Conference, PROFES 2013, Paphos, Cyprus, June 12-14, 2013. Proceedings, Springer , 2013, 35-49 s.Kapittel i bok, del av antologi (Fagfellevurdert)
    Abstract [en]

    In this paper, we report on a case study on development impediments encountered in the early phase of a transformation to agile methods in a software development organization. Drawing from literature and anecdotal evidence, it was assumed that the majority of the impediments were related to software testing. To investigate this, we performed a case study seeking qualitative and quantitative evidence from task boards, interviews, and observations. Our analysis indicates that the major challenge in the transformation undertaken by the studied organization was coordination and communication in the large, and that testing was the major challenge only when the unit of analysis was restricted to the teams in the department.

1 - 29 of 29
RefereraExporteraLink til resultatlisten
Permanent link
Referera
Referensformat
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Annet format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annet språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf