How Professional QA Lead Set Goals For A Test Department?

Internal Learnings & External Learnings

Unless and until the project executed by you is very unique (either in terms of functionalities, scale, web design trends, programming language being used, etc.); there is a high possibility that you would be able to find valuable learnings within the organization or outside the organization. You could look for projects of a similar scale, domain, & technology to inculcate the learnings from the test lead of that project.

In cases, where you are unable to get similar projects from within the organization, look for similar references from outside the organization (testing centric journals, internet, speaking to domain experts (at an abstract level) from other companies, etc.). The whole intent is to avoid or reduce the effort involved in reinventing the continuous integration wheel so that that time can be utilized for planning & execution of other activities related to testing. Plus, you need to be aware of current software testing trends in the industry, and one widely adopted software testing methodology is Shift Left Testing.

Defining Short/Long-Term Goals

Every activity that is planned during the course of any project will (or should) have a tangible/measurable outcome associated with it. While planning the activities, the strategy that my team & I followed is attaching ‘goals’ with each activity. There could be short-term goals and long-term goals. The division of goals can be something like short-term goals, long-term goals, team goals, and goals at the Business Unit (BU) level.

For example, if your team is building a web product and you wish to perform a thorough cross browser testing to evaluate how well you web-app works when accessed through different browsers and operating systems. In that case, the short team goal (as far as cross browser testing) is concerned would be to perform functional & non-functional testing on most popular/widely used browsers. TestMu AI offers you latest browser versions so that you can test on Chrome, test on Firefox browsers, test on Safari browsers, test on Opera browsers,test on Yandex browsers, test on Edge browsers and testing on Internet Explorer browsers (for legacy apps) running on various operating systems to perform manual and automated cross browser testing.

You can relate this with progressive enhancement for cross browser compatibility, where the basic functionality is delivered on the latest and most widely used browsers and improvisations or expansions to legacy browser versions come at a later stage. Once the necessary functionalities are verified, cross browser testing should be performed on the combination of different browsers, operating systems & devices. This should be a ‘long-term goal’ at the project level. TestMu AI can help you with thorough validation of cross browser testing by providing an ecosystem consisting of 3000+ browsers(modern as well as legacy browsers) supported by various operating systems. Here is the complete list of browsers of TestMu AI.

While setting goals for test department, it should be necessary to keep the big picture in mind and align these features with goals at your ‘organization level’ as well. When setting goals for your test department, it is important to set goals that are not highly audacious and practically achievable. Keep your higher management looped in as well, that way, the goals you set for your test department/ team can align the goals as per organization’s plans. In a nutshell, the defining goals for your test department should be set on the following lines:

• What are goals that are internal to the team?
• What are the goals that align with the goals at the department level?
• What are the goals that align with the goals at the organization level?

Depending on the timelines of the project, you should have goals divided into short-term (quarterly), mid-term (half yearly), and long-term (yearly) basis. It is important that you associate ‘output/deliverable’ associated with every goal.

Team Size & Domain Competency

You don’t need the same count of testers as you have for developers. Having the right team composition is important for the successful execution of any project. This is applicable while setting up goals for the testing team as well. The team composition is based on factors like project timelines, budget, competency requirements and many other variables.

Depending on the complexity & nature of the project, you should have the right mix of team members who have the right experience and expertise. While setting up the team, you can approach members who have proven project experience (within the team/the organization) and in case you are unable to fill the positions, you should hire testers who can be a good fit for the project (and the organization). Team size definitely has a huge impact on the overall goals set by your team; hence make sure that you have the right team size. For projects of shorter duration, many companies follow a ‘lean team policy’ where expert testers are a part of the team so that deadlines are met and less effort is spent on ramp-up & project coordination activities.

Based on the type of the project, you should shortlist the right tools for ‘automation’ so that testing can be more foolproof. Having a couple of people who have hands-on experience with the ‘shortlisted automation framework’ is important since they can drive & motivate the junior members in the team.

In a nutshell, while building the test team; you should ensure that the team is neither too big nor too small. Have people with the right experience, expertise, and attitude in the team so that the team composition is balanced since the project deliverables depend a lot on these factors.

Risk & Deadline Analysis

Irrespective of the size of the project, every task planned during the project execution will have a certain level of risks & assumptions associated with it. As a test lead, you should do a thorough SWOT (Strengths, Weaknesses, Opportunities, and Threats) analysis and come up with a risk mitigation plan. For example, if you are working on a hardware product; you should add risks like the delayed shipment of test samples, delayed software deliverables from the development team, etc. into the risk mitigation plan.

Every risk is associated with an outcome and you should always have a Plan ‘B’ ready (also called as the Backup plan) in case there is a slippage in the deadlines. As a test lead (or someone who is leading the test team), you should motivate the development & test teams to develop a culture of ‘collaboration’ and instill the importance of detailed testing in the minds of developers. This requires a huge shift in the development mindset and is only possible by having workshops, meetings, etc. with the development & test teams.

Adapt As Per Your Environment

The approach that you follow for a startup (early-stage or growth stage) will be quite different from the approach you follow for a multinational company. It also depends on the team size and scale of the organization. Normally in a startup, there is a flat hierarchy, hence the number of approvals from different executives would be few in number. The advantage with such an approach is that you can focus on core testing activities, rather than spending time on coordination related tasks.

Talking about startup, let me inform you that TestMu AI offers a unique pricing plan for all startups offering a heavy discounted pricing.

Back to basics, the situation can be completely different for a big enterprise/multinational company. Hence, you may need buy-in from multiple stakeholders which can be time-consuming and in worst scenarios; discussions can result in a deadlock. It is crucial to consider these factors when determining your bandwidth for the release.

You need to be fully aware of yours and your team’s bandwidth based on the work culture for setting up goals for a test department. As a test lead, you should be adaptive to the overall culture in the organization and parameters like team size, team expertise, project deadlines, risks, etc. You cannot have a ‘one size fits all’ as you set up goals for your test team or develop a test strategy.

Wearing Multiple Hats

Many organizations (irrespective of their size) now use Agile methodology where people & interactions are given more importance than processes. The key advantage of the Agile approach over the traditional Waterfall model is the improved level of communication between the development & test team. These teams no longer work in a silo which reduces the turn-around time of finding bugs through testing.

If your organization is using an Agile approach for project execution, you might need to wear multiple hats where you may also need to play the supporting role to the Scrum Master. You should identify a piece of work that is done well and has greater value at an organization level. You should push the test team & development team to stabilize the features and once done, you can share the learnings with the key stakeholders (including test leads from other business units) within the organization. This task would help you to build more inter-team & intra-team synergies and would result in cross-pollination of skills (and learnings).

Though there are plenty of tools to record pass/fail rates, code coverage metrics, etc., you should not shy away from using the traditional excel spreadsheets to record the same. This may be helpful in some projects and your responsibility should be to share the learnings with your team members. If you are following the Agile approach, you would definitely be doing sprints/regular standup meetings. Being a test lead, you should try your level best to fit the testing tasks into the sprint cadence as you set up goals for the test department.

Competency Development

In the points that we have discussed so far, ‘project deliverables & deadlines’ have been associated with each task involved in development, debugging and testing. Though you need to set goals to ensure that project timelines are met and a quality application/software product is shipped to the customer, there are many other factors that you need to consider while setting goals for your test department. One of them is ‘competency development’ of the test team.

Based on the experience & domain knowledge of each team member, you should come up with a detailed plan with goals where respective team members can explore complex areas of testing, learn some new automation tools such as TestMu AI, something that can help in building their overall competency. Some examples of competency development could be exploring automated cross browser testing platforms for validating success/failure on browser compatibility testing, using the selenium webdriver or any alternative to that, study of different testing tools (automation and script-based), and exposure to testing communities like OWASP (Open Worldwide Application Security Project) & security frameworks like ASVS (Application Security Verification Standard).

There might be many testers who are into black-box testing, but they would have an inclination towards automation testing. This kind of approach would be helpful for them to explore their interests, thereby making them more knowledgeable & self-confident.

I usually have a one-on-one discussion on every quarter with each individual tester who works under me. This discussion helps me to understand their interests and to realize whether they are happy with the type of testing they are responsible for.

Once a tester develops necessary competency/skills required for the project, the tester can play more than role, which would not only create a positive environment in the team but would also help you with having a great utility player on board as well.

How Does AI Change Goals for a Test Department?

AI shifts test department goals from writing more test cases to reviewing, maintaining and trusting the tests that AI tools produce. A QA lead now needs goals for AI-assisted test creation, for test upkeep and for testing AI features inside the product.

• AI test generation: Playwright Test Agents ship a planner, a generator and a healer that explore an app, write test files and repair failing tests. Track how many generated tests pass human review, not the raw test count.
• Model Context Protocol (MCP): Playwright agents use MCP to connect a large language model to a real browser. Set a team goal that defines which suites an agent may run and who approves the results.
• Flaky test rate: The Playwright healer agent runs the suite and repairs failing tests automatically. Track every healed test and the flaky test rate so an automatic fix never hides a real defect.
• LLM feature testing: A feature built on a large language model can return different text for the same input, so exact-match assertions break. Set goals for evaluation datasets and pass thresholds instead.
• AI testing skills: The ISTQB Certified Tester AI Testing (CT-AI) v2.0 syllabus covers data, machine learning models and generative AI testing. Use it as a named target for competency development goals.

AI tools still need human oversight. A generated test can assert the wrong expected result, so keep a human sign-off step in every AI-assisted goal.

What If you Only Have A Solo Or A Couple Software Testers?

The major advantage of having a team of multiple software testers is that you can find the flexibility of getting the work done by another tester if one is unable to do so. However, things would look completely different when you have a solo or a couple of tester in the team. You may have to come up with a different testing strategy in order to save cost or there is really no requirement to build a test team (considering the scope & size of the project).

If your test team has only a solo or a couple of software testers then you should keep them motivated at all the times. As the work pressure could be immense for them. Your major responsibility would be to conduct regular meetings & clearing the roadblocks so that they can stay focused on the job assigned to them.

When you only have a maximum upto couple testers, then these testers should themselves be an advocate of testing through workshops, talks, etc. They should understand the importance of testing in the members associated with the development team so that more & more members understand the importance of quality!

As a test lead, it is your responsibility to showcase the tester’s work to higher management through visual aids like charts, Kanban boards, Zenkit, Blossom, etc.

Conclusion

To set up goals for test department, a well-balanced team is very important for the successful execution of any project. Depending on the type & complexity of the project, you should allocate the right number of test resources for ‘manual testing’ and ‘automation testing’. The senior members of the team should not only showcase their technical know-how, but should also be responsible for motivating & supporting the junior members of the team.

For a web product, manual testing alone may not suffice since you have to verify the functionalities on many devices, browsers, and operating systems. Setting up an in-house verification lab that house all these resources could be an expensive bet. My advice to you would be to opt for a scalable & reliable cross browser testing solution on the cloud. You can use TestMu AI for manual testing and automation testing for validating cross browser compatibility. TestMu AI would help you with more than 3000+ browsers to test from. Your test team members who are well-versed with automation frameworks like Selenium can utilize the capabilities of TestMu AI cloud to build scalable test solutions.