Our Year in Review 2023 – A Recap and Look Ahead

Digital Experience Testing Cloud for Enterprises

To help developers and testers with quick developer feedback and faster release velocity, we rolled out the digital experience testing cloud for enterprises.

TestMu AI digital experience testing cloud enables enterprises to choose from a variety of testing options, including cross browser testing, real device testing, visual regression testing, and Smart TV testing. This provides enterprises a comprehensive coverage across all omnichannel options.

Therefore, enterprises have the flexibility to decide their preferred deployment mode, whether it’s dedicated cloud or on-premise. Additionally, they gain access to centralized test analytics and observability, consolidating all test execution data for informed decision-making.

Live With HyperExecute Private Cloud

TestMu AI went live with its new feature – HyperExecute Private Cloud on Azure Marketplace.

HyperExecute provides you with the option to perform test execution quickly, achieving maximum speeds, even if you are on private cloud infrastructure. Leveraging this feature gives you complete authority over your testing setup and execute tests according to your preferences, all the while ensuring the security of your data.

While maintaining data security, you can also harness other intelligent functionalities from HyperExecute, like auto-grouping, auto-retry, and fail-fast mechanisms to help developers and testers to redirect their focus toward other critical tasks, minimizing the effort required to manage tests.

AI-Native Test Intelligence Platform

Last year, TestMu AI got deeper into the AI world and launched some AI-driven features.

The newly introduced Test Intelligence platform was one of our major initiatives towards Artificial Intelligence. This AI-infused platform is designed to learn and improve with each test run, fine-tuning its recommendations and improving its predictive skills so that your team may focus more time and work to creating robust tests and getting faster feedback.

The Test Intelligence platform can help testers to increase their productivity, speed up delivery times, improve software quality, and shorten release cycles. Powered by advanced AI algorithms, the platform provides crucial insights into potential issues, identifies various bugs, and helps the team prioritize and fix them efficiently.

Additionally, we introduced support for custom flaky test detection in Test Intelligence. This feature provides a list of flaky tests and a description of why the test is flaky. You can also view the history of the flaky tests and the total number of failed tests. This lets you identify flaky tests and make required fixes to raise the overall reliability of your test suite.

HyperExecute – AI-Native Test Failure Analysis

Test case failures have long been an issue for organizations. Identifying and resolving these issues takes a significant amount of effort and resources.

Manually analyzing several logs and data sources for test failure analysis, aka Root Cause Analysis (RCA), causes delays in issue resolution, and even after RCA, significant time is required to create and implement the right fix. This inefficiency reduces productivity and slows the whole software development process.

To address this challenge, last year, TestMu AI HyperExecute came with an AI-native Root Cause Analysis (RCA) feature to provide an in-depth classification of issues, allowing for quick identification of failure types and instant access to the relevant fixes.

The RCA feature in HyperExecute eliminates the task of tedious manual checks, as its user-friendly interface categorizes numerous issue types associated with failed test cases.

PDF Testing With AI-Native SmartUI

To improve your experience with automated visual regression testing, we introduced the Smart UI platform. Since then, we continuously gathered customer input to improve and scale the Smart UI platform. In 2023, TestMu AI Smart UI released PDF testing, a much-needed addition to visual regression testing.

This feature will help you ensure the quality of PDF documents, create comprehensive reports, and verify PDF files by looking for variations in text, layout, pictures, or other elements. This makes PDF testing easy and efficient.

With Smart UI PDF testing, you can

• Convert PDF pages into images while maintaining the accuracy of the font, layout, and graphical elements.
• Take advantage of the flexibility in handling complex files with compatibility for multiple PDF versions and embedded content.
• Unzip and extract the PDF files to verify and compare rendering results.

SmartWait Functionality for Selenium Automation Testing

The persistent issue of flakiness in tests resulting from unpredictable webpage loading speeds or dynamic content rendering is one that developers and testers constantly deal with. To overcome this challenge, we launched the SmartWait feature for Selenium testing.

With SmartWait, you can enhance the accuracy and efficiency of the automated testing process. It does numerous actionability checks on each website element before performing any actions on it.

Through the use of an advanced algorithm, SmartWait pauses to take action until all necessary checks have been successfully completed. If the tests are not passed in the specified amount of time, it returns the relevant Selenium error message.

Auto Healing Feature in Selenium Web Automation

Following SmartWait, we added another groundbreaking feature, auto-healing, for Selenium automation. When used in test automation, auto-healing automatically adjusts to dynamic changes in web components, including loading times or AJAX queries, therefore mitigating synchronization challenges.

Auto-healing in Selenium dynamically modifies wait durations and ensures that test scripts run without interruption, even in cases of website changes or delays. Auto-healing improves stability in test automation by effectively handling timing-related issues and minimizing the possibility of flaky tests brought on by synchronization issues. So, test scripts can adjust to varying conditions due to auto-healing features, which synchronize the test script and the web application being tested.

All-New UnderPass Desktop Application

To further optimize your local page testing experience, we revamped our UnderPass Desktop tunnel application. You can test web apps hosted on your local server across over 3000 desktop and mobile browsers using the TestMu AI UnderPass tunnel.

For this, you don’t need to run any commands from your terminal to do this. It is a desktop application that uses a graphical user interface (GUI) to establish a Secure Shell (SSH) tunnel between your operating system and our cloud servers.

Here are the new features of the revamped UnderPass desktop application:

• Revamped user interface
• Multiple tunnel management
• Advanced configuration
• Seamless log sharing
• Login with Google, GitHub, and SSO

Bonus: We also added an extension for TestMu AI Tunnel on Docker Marketplace.

LT Browser 2.0 and Real Device Cloud on Product Hunt

To help developers build amazing responsive experiences, we launched the revamped LT Browser 2.0 on Product Hunt. In 2022, we revamped the LT Browser to elevate your responsive testing across 53+ pre-installed viewports. So, launching LT Browser 2.0 on Product Hunt was a significant leap forward for web developers and testers. We ended up being 5th Product of the Day.

Moreover, we also launched TestMu AI real device cloud later in 2023. This platform lets devs and testers perform real-time and automated app testing with frameworks like Appium, XCUITest, and Espresso.

Some Other Power-Packed Features

Besides the above features, the following are some powerful features we rolled out in 2023.

Web Automation

• Test using Playwright on real Android devices.
• Generate Lighthouse reports in Playwright to track website performance metrics.
• Automate geolocation tests for Cities.

App Automation

• Tests on real devices like the iPhone 15 series and Google Pixel 8 and 8 Pro.
• Inspect using built-in Intelligent UI Inspector on real devices for real-time app testing.
• Test biometric authentication on real devices.
• Use app profile for mobile app automation.

Real-Time App Testing

• Test your mobile applications on Android 14.

Smart UI Testing

• Perform visual regression testing with Smart UI using Playwright, Puppeteer, and Storybook.
• Run visual regression tests using Smart UI CLI.
• Use the Smart Crop feature in Appium visual testing.

HyperExecute

• Mute your tests using the Auto Muting functionality in HyperExecute.
• Get Test Case Insights in Test Analytics for HyperExecute testing.
• In-depth analysis and debugging using the Snooper feature in HyperExecute.

Array of Fresh Integrations

We are always looking for ways to enhance your testing experience. Thus, we have added an array of fresh integrations to ensure seamless project management, continuous integration, visual regression, bug tracking, and others.

Here is the list of TestMu AI Integrations for 2023:

• Katalon
• Docker
• FogBugz
• Webex Teams
• Linear App
• k6
• Netlify
• Chrome DevTools Recorder
• Zoho Cliq
• Airbrake
• LocalStack
• Userback
• Axosoft
• Pivotal Tracker
• New Relic
• Gradle
• Zenkit

Successfully Hosted Testµ 2023 – 2nd Edition

After the roaring success of 2022, we successfully hosted our second virtual global testing conference, Testµ Conference 2023, while also celebrating TestMu AI’s sixth anniversary.

Reflecting on the incredible three days we spent together at Test 2023, we are pleased with what we experienced. During this time, we had some great discussions, explored some cool new ideas, and participated in exciting keynote talks, workshops, and panel discussions. It was all about how powerful it can be to share our ideas and thoughts with the testing community.

In this second edition of Testμ Conference, we had 35+ sessions from 60+ speakers with a 1.5M+ audience reached from 105+ countries.

Watch for our Complete Playlist of Testμ 2023 Conference on the TestMu AI YouTube Channel.

Delta Awards in Testing

We announce the Delta Awards in Testing to recognize and reward testers and developers who play an important role in the community and at their workplaces by advocating for world-class QA practices and providing valuable feedback to improve product quality and usability.

The TestMu AI Delta Awards recognize everything from emerging talents, world-class leaders, and testing teams to innovative open-source contributions/projects. The Delta Awards has five categories: Rising Tester of the Year, Best Test Leader of the Year, Best Test Team of the Year, Best Contributor to Open-Source Testing, and Best Open-Source Project in Testing.

Hosted 20+ Webinars

We believe webinars are the most effective way to stay connected with the testing fraternity. So, last year, TestMu AI successfully hosted 24 webinars. Out of this webinar, we have hosted 10 episodes of Voices of Community.

Bringing the community to the forefront, we introduced XP Series, a monthly talk discussing a wide range of topics in the testing ecosystem. This series has knowledge-sharing recorded webinars or podcasts and fireside chats with business leaders from leading enterprises and tech organizations. Other than this, we hosted 4 open-source webinars in October.

TestMu AI Bootcamp

To get hands-on experience in leveraging TestMu AI for your test orchestration, we introduced TestMu AI Bootcamp. This lets you explore our in-depth technical sessions, connect with like-minded folks, and advance your career.

With TestMu AI Bootcamp, you can learn and explore the TestMu AI platform, including for web and mobile automation, HyperExecute, Smart UI, and Test Intelligence. Also, you can participate in the Test & Run challenge and win exciting prizes. Also, Bootcamp certifications let you validate your automation skills to the next level.

Issued 2300+ Certifications

Congratulations to our certificants for earning in-demand TestMu AI certifications. Achieving these certifications requires a great deal of effort and dedication. We are proud of your accomplishments and wish you all the best for future success.

Last year, we issued over 2300 certifications. As a part of the TestMu AI and Accenture Testathon, we certified 1560+ candidates. Besides, we also launched some new certifications:

• Manual Testing Certification
• Automation Testing Certification
• HyperExecute Certification

On LinkedIn Learning, we launched our second TestMu AI Software Testing Professional Certificate.

Awards and Recognition

First, we sincerely thank all our power users and partners for their valuable feedback. In 2023, G2 ranked TestMu AI as one of the Best Software Companies in India.

We were also recognized as a Global Finalist for the Microsoft Cloud Native App Development Partner of the Year award. Partnering with Microsoft has accelerated our aim of providing innovative, continuous-quality solutions that help customers deliver high-quality web and mobile applications.

Some Special Memories

2023 has been an awesome year for us – full of growth and celebrations. Here’s a quick look at some cool stuff that went down this year.

TestMu AI Turned Six

Time does fly when you’re having a blast, and we’ve had loads of fun over the last six years. To mark this milestone, we celebrated Founder’s Day and threw a bunch of games and activities as a part of our celebration. Huge thanks to our users, team, and partners for the support. We’re looking forward to 2024, continuing to serve the testing community.

Diwali Celebrations

We had a fantastic time celebrating Diwali at TestMu AI. Our office was all decked out with vibrant lights and traditional decorations, creating a lively atmosphere. We added to the festive spirit by organizing a bunch of enjoyable activities for our team. It was a joyous celebration filled with enthusiasm and good vibes.

Christmas Celebrations

At TestMu AI, we celebrated Christmas by decorating our offices with festive cheer and doing fun activities. One special tradition we have is a Secret Santa gift exchange, where we give surprise gifts to each other. We also organized a Christmas-themed team event, making the season joyful and full of laughter. Christmas at TestMu AI was a time for enjoyment, celebration, and sharing the holiday spirit.

The Road Ahead in 2024

Beyond these product features and accomplishments, our roadmap in 2024 is brimming with new features that we can’t wait to show you soon! We are working on adding more features to the HyperExecute Smart UI cloud, and Test Intelligence and expanding our test orchestration and execution infrastructure with cutting-edge AI features.

We look forward to continuing to empower digital transformation, bringing even more innovation to the market.