November 30th
SAST Q4 Digital Testing conference
	Time		Track 1 Track chair: Tobias Gilbertsson YouTube link		Track 2 Trach chair: Jörgen Damberg Presentation links below		Track 3 Track chair: Eva Persson Presentation links below		Track 4 Track chair: Emil Alégroth Presentation links below
	09:00 - 09:15		Welcome (Zoom link)
	09:15 - 09:55		Augmented Testing		Testing in the Imperial Database Link to presentation		How can we use nudging (using choice architecture) when we are doing agile testing Link to presentation		End-to-End Web Testing: Fundamentals, Best Practices, and Tools
			Stevan Tomic & Johnny Blomberg (Synteda/Symmatiq)		Samuel Nitche (Smart Enterprise solutions)		Ard Kramer (OrangeCrest consulting B.V)		Maurizio Leotta
					Samuel Nitsche is a curiosity-driven software developer who programs, learns and collaborates in the software trade since the early 2000s. He works as Senior Software Developer and trainer at Smart Enterprise Solutions GmbH. His main interest is on modern database development, automated testing and code quality, topics he writes regularly about on different platforms (e.g. his blog https://developer-sam.de, Simple-Talk and several Oracle-related print magazines). He is an Oracle ACE, one of the main contributors and maintainers of utPLSQL (http://utplsql.org) and loves to share his experience in an entertaining way - gladly in Sith robes - at meetups and conferences.In a fast-changing tech world, there is one thing that commonly stays the same for years or even decades: the system that holds the data. This data is often one of the most important assets of a business and it’s critical to keep it safe and in good condition. In this talk, I want to show you that it’s not only viable but also a lot of fun to do this directly at the database level! Join me on a journey to the infamous Death Star, where the Galactic Empire runs the Imperial Database™ with all the expectable problems of a complex, long-running software system. It has survived numerous iterations of different frontend-systems - and we are suddenly responsible to ensure the stability and reliability of the data, while constantly dealing with new changes and features. We will quickly learn that there are some challenging key differences between testing in databases and testing in applications, but will also meet new friends like “Team Transaction” and use practical examples to answer a number of questions: What can we test for in a database on a high and low level? How can we introduce automated tests to a database? And what are these ancient relational force-techniques that can be used to prevent errors before they appear? While the Imperial Database™ runs on Oracle, all of the examples will be presented in a way that is adaptable to other relational databases. Having beginner-knowledge about SQL is beneficial for attendees.		Ard is a software tester from the Netherlands and he works at OrangeCrest. He calls himself a Qualisopher which stands for someone “who loves truth and wisdom and at the same time is decisive to improve man and his environment” . This means he is interested in the world around us, to see what he can learn and he can apply in software testing. His dream is to participate, as a good qualisopher, in all kind of projects such as sports, culture or software testing. Projects which add value to our community: he wants to inspire other people by cooperation, fun and empathy and hopefully bring light in someone's life.Biases have been the subject of quite some talks on stage nowadays. Biases that are a threat to delivering high-quality software. And for sure there is a lot to worry about, we all know for example that we assume that we know exactly what our stakeholders want, and we still produce not working software. But is it also possible to use those biases in the favor of quality and testing? In fact, there is a way that biases are used positively, and it has a name: nudging. Nudging uses ‘choice architecture’, which means creating a situation where you can make an unconscious choice for a good purpose. It is used a lot in marketing and politics, for example how a grocery store, using green arrows to the fruit and veggie aisles, increase the sale of healthy food. I looked at different opportunities that nudging gives us for the sake of better agile testing. For example, in a refinement or in a discussion about bugs or when we are delivering our results to our team or our stakeholders. In my talk, I will elaborate more on what nudging exactly is, the ethical questions around nudging, and how we can apply nudging while testing. It will be an exploration so bear with me.		Maurizio Leotta is a researcher at the University of Genova, Italy. He received his PhD degree in Computer Science from the same University, in 2015, with the thesis 'Automated Web Testing: Analysis and Maintenance Effort Reduction'. He is author or coauthor of more than 80 research papers published in international journals and conferences/workshops. His current research interests are in software engineering and testing.End-to-end automated test scripts are a great way to ensure the quality of web applications but are often perceived as expensive both during their initial development and subsequent maintenance activities. This talk will provide an overview of: (1) the fundamentals of E2E web testing; (2) several best practices that can help to reduce the costs when adopted in industrial settings; and (3) some research tools that can be useful for the practitioners interested in E2E web testing. For more information about studies and tools, visit: https://person.dibris.unige.it/leotta-maurizio/
	09:55 - 10:35		Using continuous integration to boost non-functional testing		Crushing the seasonal rush Will not be recorded		Being a Software driven company, Volvo Cars Link to presentation		Production Monitoring to Improve Test Suites Link to presentation
			Liang Yu (BTH)		Raluca Morariu (Paddy Power Betfair)		Martina Landén (Volvo Cars)		Deepika Tiwari (KTH)
			Liang Yu is a developer at Ericsson mobile financial services, and an industrial PHD student focused on CI and NFR testing in Blekinge Institute of Technology. What is the key to success to improve software quality from non-functional aspects? Experience, challenges, and guide in using CI environments for automated non-functional requirements (NFR) testing will be presented. The presentation is based on the practices of automated NFR testing with CI tools in five different industrial business domains.		With over 13 years experience in the software industry Raluca has started her career as a developer back in 2006. Having shifted her career to testing in 2011, she started working at PaddyPowerBetfair(part of the Flutter Group) as an automation specialist, where she led the efforts around continuous delivery, automation and performance testing. In her current role as a Delivery Manager she is responsible for project delivery, people management of multiple teams while still being involved as a tester advocate in the overall testing effort of the company, especially in areas related to microservices automation and testing ways of working.Throughout the world there are a lot of industries and teams that face seasonal high peaks of their activity. "Black Friday" and "Cyber Monday" have just happened, the rush to Christmas shopping is following soon too. And these are all happening while we all use online stores more and more due to the pandemic. And it's not just e-commerce, many industries run on an annual cycle. How do software teams prepare for a big seasonal onslaught of traffic to their web application or other critical deadlines? How do testers in those teams male sure they build quality in, to face calendar-related challenges? Join me in this session to find out!		What does it mean to be a software driven company.		We introduce PANKTI, a novel technique that uses production executions to improve the quality of testing for certain methods of interest for developers. These methods can be methods that are not covered by the existing test suite, or methods that are poorly tested. PANKTI monitors applications as they execute in production, and then automatically generates differential unit tests, as well as derived oracles, from the collected data. PANKTI’s monitoring and generation focuses on Java. Our experiences with open source projects show that PANKTI's generated tests improve the quality of the test suite of the applications under consideration.
	10:40 - 11:20		Testing Autonomous Driving Systems in simulator: The case of Apollo & SVL		Framtidens QA Link to presentation		Exploratory Testing of Large-Scale and Complex Software Systems Link to presentation		Industry-academia collaborations in Software Testing: Lessons learned and best practices from 20+ years of experience Link to presentation
			Hamid Ebadi (Infotiv)		Ingela Hagman (Zington)		Torvald Mårtensson (SAAB AB)		Vahid Garousi
			PhD in computer science interesting in AI/ML, V&V, Security and Privacy.The Infotiv research group was part of a Swedish team for the "2021 IEEE Autonomous Driving AI Test Challenge". During the challenge, the team designed a tool to aid the automatic generation of various traffic scenarios to verify and validate the safety functionality of autonomous systems. In this presentation we share our experience and challenges that we faced for testing Apollo autonomous driving systems in SVL simulator.		Ingela har arbetat med test och kvalitetssäkring i mer än 10 år med erfarenhet från myndigheter och verk, fastighets- och resebranschen. Ingela har erfarenhet från bl.a. kvalitetssäkring i agila utvecklingsteam och införande av nya produkter och koncept i nära samverkan med verksamheten.I takt med att vi blir mer och mer digitala i vår vardag och i vårt arbete höjs kraven på kvalitet i de kanaler och verktyg vi kommer i kontakt med. Kvalitet är inte längre förhandlingsbart. Kvalitetsarbete i ett utvecklingsprojekt är ingen ”one-man-show” och är därmed alla i teamets ansvar. Men hur ter sig då arbetet för att främja kvalitet i ett utvecklingsprojekt när det är allas ansvar? ”Allas ansvar är ingens ansvar” eller vad säger ordspråket? Följ med mig in i det jag kallar för ”Framtidens QA” som är mer av ett förhållningssätt än en roll men som med fördel ska ledas av någon för att peka ut riktning och plocka upp det vi tappar på vägen. Jag jobbar själv utifrån detta förhållningssätt idag och kommer under denna föreläsning dela med mig av vad jag ser som utmaningar respektive möjligheter med detta sätt att jobba. Jag ser gärna att alla möjliga kompetenser är med mig under denna föreläsning då detta är en angelägenhet för alla kvalitetsmedvetna. För vem är inte intresserad av snabba, högkvalitativa leveranser fyllda av kundnytta? Och där har vi alla ett ansvar.		Exploratory testing is a creative and experience-based approach, as it is not based on pre-designed test cases. This talk will describe how exploratory testing is used in the Gripen E project in a test method based on virtual test-teams, with experienced engineers representing different subsystems. We will also talk about the key factors that enable efficient and effective exploratory testing, identified in research studies including eight multi-national companies in separate industry segments. Finally, this talk will present the MaLET model - a representation of the typical evolution path for companies adopting exploratory testing. Experiences from large-scale industry projects reveal that the path is not always forward in the MaLET model, and that improvement initiatives tend to fail if they are not planned in an order corresponding to the maturity levels.		Vahid Garousi (PhD, PEng) is the Director of Bahar Software Engineering Consulting, based in Belfast, UK, and also an Associate Professor of Software Engineering in Queen’s University Belfast. Since year 1998, he has provided consultancy and corporate training to software teams and companies in different countries. He is an advocate for more active industry-academia collaborations in Software Engineering. His areas of expertise include: software engineering, software testing, and test automation. For more information, visit: www.vgarousi.com. The speaker started his software-testing career in year 1998, by using automated record-and-playback GUI testing tools in his first job. Since then, he has been working in the interface of industry and academia, in four countries (Canada, Turkey, Netherlands and the UK). He has conducted joint R&D projects with and also provided consulting to 50+ industry partners in various areas of software testing and QA, e.g., model-based testing, BDD, decision-support for test automation. In this talk, the speaker will review briefly the technical aspects of a few of those projects, and then discuss some lessons learned and best practices from those projects. A main objective of his talk will be to highlight the success stories in industry-academia collaborations in software testing, and to encourage further such collaborations.
	11:20 - 12:00		11 years of Software Engineering at Spotify		Busting Testing myths Link to presentation		Digital Tillgänglighet - vad är det och hur ska jag börja?		Testing and Evaluation of Autonomous Driving Systems: From Simulated to Real-world Test Environments Link to presentation
			Kristian Karl (Spotify)		Joss Åkesson (Tretton37)		Anna Stålberg		Andrea Stocco & Gunel Jahangirova
			Kristian Karl is an Engineering manager at Spotify. He started there as a test manager in 2010. At that time there were 50 people working in R&D, today thousands engineers are working at Spotify. Kristian will share experiences he has made at Spotify in regards to software engineering over a time frame of more than 10 years. Topics in the talk will be: - The development cycle - How planning can help - Teams - Their ways of working - Quality With his presentation, Kristian hopes that the audience will get some insights and takeaways that they might find useful in their workplaces.		Tester & Domain Lead for Quality & Security at tretton37. Explorer and UXplorer. Engager and enabler. Tester with team management skills that find communication to be the most important work tool. There are many preconceived notions and outright myths around what testers should and shouldn't do, but also when, and how. In this session we will take a closer look at and bust some of these myths!		Anna har tyvärr fått förhinder att medverka. :/		Gunel Jahangirova is a PostDoctoral Researcher at the Software Institute of Universita' della Svizzera Italiana (USI) in Lugano, Switzerland. She had her PhD in a joint program between Fondazione Bruno Kessler, Trento, Italy and University College London, London, UK. Her PhD work was about oracle problem in software testing, in particular, assessment, improvement and placement of test oracles. Her current research interests include automatic generation of program assertions, mutation testing, failed error propagation and testing of deep learning systems. Andrea Stocco is a postdoctoral fellow at the Software Institute (USI) in Lugano, Switzerland. His research interests include software testing and empirical software engineering, with particular emphasis on monitoring techniques and automated functional oracles for deep learning systems, and automated repair, robustness and maintainability of test suites for web applications. Modern autonomous driving systems are tested using simulation platforms that model the interactions of the vehicles with the environment. Simulated testing is expected to increase the degree of confidence in self-driving cars prior to in-field development and testing. However, would the testing results obtained using such simulators correlate with those of in-field testing? The talk showcases the efforts of our group in testing autonomous driving systems, such as the automated construction of oracles and their evaluation using mutation testing, the preventive detection of unsupported driving situations, and the transferability of testing results to real-world environments.
	12:00 - 13:00		LUNCH
	13:00 - 13:40		Panel debate		User Plane Verification in Ericsson Packet Core Link to presentation		How to make it sticky, experiences from large scale transformation from classic to agile development Link to presentation		TESTAR - open source tool for scriptless GUI testing Link to presentation
					Mathias Adler (Ericsson AB)		Lars Persson (Volvo Cars)		Pekka Aho
					Verification challenges when adopting existing products to cloud native				Pekka Aho got his PhD from the University of Oulu (Finland) in 2019 on a topic related to scriptless GUI testing and state model inference. He has been involved in test automation research and practice since 2009, working in close collaboration with the industry. He joined the TESTAR team and the Open University of the Netherlands in 2017.TESTAR generates test sequences during the automated test execution. TESTAR supports various action selection algorithms, always choosing from the available actions in the current state of the GUI. Since TESTAR automatically adapts to the changes, there is no test case maintenance. However, defining test oracles is more difficult because the test generation might involve some randomness. Therefore, scriptless GUI testing should be used for complementing traditional test scripts.
	13:40 - 14:20		Panel debate		Risk or fear: what drives your testing? Link to presentation		Machine Learning - issues we don't talk about but introduce Link to presentation		Gamifying Software Testing Link to presentation
					Jenna Charlton (Functionize)		Olof Lennartsson, Elias Sonnsjo (Infotiv)		Riccardo Coppola
					In this talk we will discuss the issues we might introduce to the Machine Learning process (without knowing it). We also cover how to improve the process by "just knowing about the issues", and how to improve knowledge by deploying a problem (data management).		As concultants from Infotiv we work both within the field of testing & test development of traditional SW but are also involved in research projects regarding the Validation and Verification of Machine Learning components. Both have studied Machine Learning at University, performed industrial reasearch around it as well as using it at our customers. In this talk we will discuss the issues we might introduce to the Machine Learning process (without knowing it). We also cover how to improve the process by "just knowing about the issues", and how to improve knowledge by deploying a problem (data management).		Riccardo Coppola received the Ph.D. degree in Control and Computer Engineering from the Politecnico di Torino, Turin, Italy, where he currently works as a Research Assistant with time contract. His research interests include automated GUI testing for web and mobile applications, and the evaluation of non-functional properties of software projects.Manual software testing is often seen as an indispensable but unappealing activity to carry on by developers. Albeit many automated testing techniques have been defined in the last decades, manual testing is still unavoidable especially for End-to-End tests of complete applications and systems. In this talk we explore the current state of literature and practice about the Gamified approach to software testing. Gamification is the application of concepts that are proper of games to any other activity, with the objective of evoking the competitive nature of humas to encrease their engagement, entertainment and eventually their performance. The technique also allows to divide complex testing tasks into smaller operations that can be crowdsourced to non-expert users. Preliminary results have shown that this set of features have the potential to improve the whole software testing practice, and as a consequence the quality of developed software.
	14:25 - 15:05		Software Quality for the Enterprise		Would Heu-risk it? Link to presentation Extended talk: 14:25 - 15:25		The Choice is yours Link to slides Link to presentation		Fuzzing Microservices with EvoMaster Link to presentation
			Rosalind Radcliffe (IBM)		Lena Wiberg (Mentimeter)		Gitte Klitgaard (Mentimerer & NativeWired)		Man Zhang (Oslo University)
			Software has become ever present, in just about anything and everything we do, software plays a role. With its importance the quality of the software becomes more important as well. How do we drive the right quality? This session will discuss the changes in driving to a culture of quality within an enterprise, and now DevOps practices and culture are all part of the overall solution.		Lena has been in the IT-industry since 1999 when she got her first job as a developer. 2009, after a decade of code, she found her calling in testing. Since then she has worked in most testing-related roles, from lone tester in a team so building and leading testing organizations. She believes continuous improvement is something we should all strive for by keeping up to date and always challenge ourselves, our assumptions and the way things are done. She is an avid blogger, speaker and workshop facilitator. Lena lives outside of Stockholm, in a big house filled with gaming stuff and books with her family. She is currently working as an Engineering Manager at Mentimeter.The experiences and lessons learned from working with developing software since 1999 resulted in the Would heu-risk it card deck, 30+ blog posts, some articles and a book draft in 2020. They center around risk analysis, heuristics, patterns/anti-patterns and can be grouped into three distinct categories: Traps I see testers fall into, Tools I see testers use as super-powers and weapons testers could use to focus their work (also known as common weak-spots in building software). This talk will be a compilation of my main learnings from 20+ years of building software, seeing the complexity from a developer, a tester, a test lead and a manager perspective. We will use the cards as a focal point to try and cram my most important learnings into 40 minutes.		Gitte Klitgaard is an agile coach, hugger, friend, and much more. She lives and loves agile. She took the oath of non-allegiance. Why fight over methods when we can use that energy to help people? Gitte wants to change the world by helping people make the right product, doing it right and very important: have fun doing it. She has a great interest in how people function, psychological safety, courage and vulnerability,, how the brain works, what motivates us, how we can feel better about our selves, how to be perfect in all our imperfections. She is a geek and passionate about a lot. :)"This talk is about choices. It is about making active choices and about taking responsibility for those. Sometimes we don't see the choices around us or we don't want to make a decision. Sometimes choices are made, because it is the only one left. Gitte will talk about why we have a lot more choices than we think, and how taking responsibility for these choices will leed to a more free and powerful life. The talk is based partly on The Responsibility Process and Real Option, which Gitte applies in her own life, and partly by her other work as she helps organisations.		Man Zhang is a Senior Researcher at the Artificial Intelligence in Software Engineering (AISE) Lab, Kristiania University College, Norway. Previously, she obtained her Ph.D. in Computer Science at Simula Research Laboratory and University of Oslo, Norway (2015 - 2018). Her research focuses on developing novel methods for automated enterprise systems testing. Microservices architecture has been widely applied in industry that typically comprises a large number of connected web services. Enterprise applications with such architecture pose several significant challenges for their verification and validation. In this talk, I will introduce an open-source tool named EvoMaster (www.evomaster.org) which employs evolutionary algorithms and several advanced techniques to enable fuzzing of microservices.
	15:05 - 15:45				To measure of not to measure - that is the question		"Min applikation är min stad" Link to presentation		Cognition and problem-solving in software testing Link to presentation
					Maryam Umar (Thought Machine)		Jens Hauser (Frontit)		Eduardo Enoiu (Mälardalen University)
					Maryam Umar works in London as Head of QA of a Fintech firm. She started her career twelve years ago as a QA test engineer in the finance and mobile industry. After transitioning to the eCommerce sector, Maryam performed QA in various capacities for online restaurant and travel services. She continues to work in QA as a manager now with special focus on sustainable delivery practices. In addition to this, Maryam has been a keen advocate of creating and sustaining diverse teams. She has been speaking at schools and universities to educate students about what the industry has to offer and what a creative space it can be. Speaker unfortunately prevented from attending. Fixing quality is not an easy task. It involves changing the culture, changing the processes being used and sometimes even changing how engineering of software is done. But how do you know that any of the change agents you have used are actually successful? In my experience, I went ahead and started measuring quality but did not get feedback in time. In retrospect, I realised that I confused product and productivity metrics. In this talk, I want to share the metrics I measured, how I measured them and what feedback I started getting on them. I will also share tips on how best to represent these metrics and how to get team buy-in on their usage.		När Jens inte arbetar gillar han att resa till främmande länder och utforska dem med min kamera. Han använder sin kamera som ett sätt för att utforska, prata och träffa människor samtidigt som den är en huvudnyckel till människors liv. När man fotograferar människors liv, deras arbete eller deras kultur öppnar de sig alltid och berättar om sina liv. Förutom de gånger de jagar bort en förstås. Men händer inte så ofta som tur är. För Jens är fotografering som utforskande test: planera, utför, utvärdera i en loop tills du är nöjd med resultatet."Min applikation är min stad" handlar hur Jens ser på testning och då speciellt utforskande tester och att en applikation, IT-system eller webbsite kan ses som en metafor av en stad med olika stadsdelar, områden, vägar och hus som man kan ta olika rundturer i för att få djupare kunskap och lära sig hur det fungerar, hur det inte fungerar eller hur det bör fungera så att man kan förändra eller förbättra det. Under de olika rundturerna tar man olika persona, som reser i olika typer av fordon när man besöker olika delar av staden. Jens har många års erfarenhet från test- och utvecklingsprojekt och har skaffat sig gedigen kunskap som testledare och projektledare. Som testledare på Frontit är han van att jobba nära projektledaren för att få en grundlig förståelse av krav och behov för att kunna sätta upp en lämplig teststrategi. Jens är en noggrann och strukturerad person som fokuserar på att skapa struktur och att planera tillsammans med beställaren och andra teammedlemmar. Han är en lyhörd problemlösare och skicklig på att kommunicera, både i en nationell och internationell miljö men också på olika nivåer inom en verksamhet. Hans erfarenhet och vilja att alltid leverera hög kvalitet brukar framkomma som väldigt positivt i feedback från kunder.		Eduard Enoiu is a Senior Lecturer at Mälardalen University in the Software Testing Laboratory Research Group. His research interests span software engineering and empirical research, especially testing, maintaining, evolving, and assuring industrial software. He is currently doing research on a diverse array of topics, including the ethical and human aspects of software testing, the role of automated test generation in industrial practice, and the nature of creating efficient and effective tests. Problem-solving occurs throughout life. An architect may be designing a building, or a software tester attempts to find effective test cases. Depending on the problem and how one mentally represents it, different cognitive processes are used, some conscious and some unconscious. I will overview our current understanding of what testers do on a cognitive level when designing test cases and how we can better comprehend the processes that underpin problem-solving in software testing. I will also discuss prospects for building better tools as well as to better accommodate the cognitive needs of testers.
	15:45 - 16:00		Wrap-up (Zoom link)

Presentations will be made available to YouTube after the conference unless speakers requested us not to do this.

SAST West Meetup

#SASTQ42021