面向民用飞机需求验证的自动化测试技术研究

doi:10.11996/JG.j.2095-302X.2024020308

摘要/Abstract

摘要：

在商用飞机全生命周期的研制过程中，需求与概念论证环节作为商用飞机研制的早期环节，将极大地影响整个商用飞机的全生命周期成本。其中功能定义作为需求与概念论证阶段的核心产物之一，以一种统一化、标准化的描述了目标产品一系列的预期行为表达。功能性需求作为功能定义的重点输出产物，决定了商用飞机的核心产品竞争力。基于功能仿真的需求验证作为一种常用的需求质量评价手段，通过建立飞机的测试模型，仿真模拟特定场景下飞机的运行行为，以结果为评判依据确认早期方案设计是否满足需求。然而，在实际面向需求的仿真测试过程中，碍于场景外部环境的多变性，往往会出现“组合爆炸式”的测试用例，极大地增加了测试的规模和成本。为解决上述问题，提出基于模型的测试(MBT)方法，通过基于系统建模语言(SysML)模型自动化生成测试用例，缩短验证过程的周期并保证需求验证的可追溯性。

关键词: 需求验证, 测试用例, 基于模型的测试, SysML

Abstract:

Requirement and concept demonstration is the early stage of the development lifecycle of commercial aircraft, which will significantly impact the whole life cycle cost. Functional definition describes a series of standardized and unified expected behaviors of the targeted product and can be regarded as one of the core products in the requirements and concept demonstration stage. Functional requirements, as key outputs of the functional definition process, determine the core product competitiveness of commercial aircraft. As a common means for evaluating requirement quality, function simulation-based requirement verification is employed to establish a test model of an aircraft and to simulate its behavior in specific scenarios, thus confirming whether the early-stage design specifications meet the requirements based on the simulated results. However, in the actual requirement-oriented simulation process, the variability of external environmental factors in specific scenarios often leads to test cases exhibiting what is commonly known as “combinatorial explosion”, significantly increasing the scale and cost of testing. In order to solve the problem above, a model-based testing (MBT) methodology was proposed. It will automatically generate test cases based on system modeling language (SysML) models, thereby shortening the verification cycle and ensuring the traceability of requirement verification.

Key words: requirement verification, test cases, model-based testing, SysML

中图分类号:

TP391

汪澔, 武仲芝, 唐剑. 面向民用飞机需求验证的自动化测试技术研究[J]. 图学学报, 2024, 45(2): 308-316.

WANG Hao, WU Zhongzhi, TANG Jian. Automated testing study for civil aircraft requirements’ verification[J]. Journal of Graphics, 2024, 45(2): 308-316.

图/表 15

图1 MBT方法可实现的自动化流程

Fig. 1 Automated test process through MBT methodology

图2 MBT实施流程

Fig. 2 Modeling methodology process for model-based Testing

图3 模型顶层表达

Fig. 3 Model-based expression for test models

图4 状态机表达示例

Fig. 4 State machine diagram example

图5 单一链接

Fig. 5 Single link

图6 复合链接

Fig. 6 Composite link

表1 测试过程包含的元素

Table 1 Content of test procedure

内容	描述
基本属性	名称
	创建时间
	版本
	来源模型名称
	模型编号
	模型类型
测试目标	测试目标下会将该项测试过程所包含的测试用例进行表达和描述
测试过程与预期结果	测试过程将测试用例组合在一起，面向测试目标，显示从测试初始化开始，执行测试用例并得到最终的测试结果的行为描述，且对于测试用例中所定义的参数，测试过程也会定义这些参数的预期值用作后续实际测试的比对

图7 测试适配过程

Fig. 7 Test adaption procedure

表2 测试覆盖率包含内容

Table 2 Content of test coverage

序号	内容
1	需求满足情况
2	测试用例测试满足情况
3	需求覆盖率
4	测试用例覆盖率

表3 “地面减速”场景功能性需求

Table 3 Functional requirements for “ground deceleration” scenario

序号	飞机功能性需求
1	飞机应提供至少3套独立的方式用于地面减速控制：1.机轮刹车；2.反推；3.地面扰流板
2	飞机应确保反推在60节(TBC)到160节(TBC)之间使用
3	飞机应能在着陆接地后自动打开扰流板，用以增加刹车效率
4	飞机应对称地打开或收起扰流板
5	发生双发停车后，飞机应能在着陆过程中至少伸出TBD对地面扰流板
6	飞机应能在双发失效时具备地面减速能力

图8 “地面减速”测试模型顶层架构

Fig. 8 Top level architecture of test model for “ground deceleration”

图9 “地面减速”状态机模型((a)扰流板状态机；(b)刹车状态机；(c)发动机状态机)

Fig. 9 “Ground deceleration” state machine diagram ((a) Spoiler state machine; (b) Brake state machine; (c) Engine state machine)

图10 测试用例((a)基本控制状态覆盖；(b)基本控制状态对覆盖；(c)状态转变覆盖；(d)修正条件判定覆盖)

Fig. 10 Test cases ((a) Basic control state coverage; (b) Basic control state pairs coverage; (c) Transition coverage; (d) Modified condition decision coverage)

图11 预期测试过程及期望结果

Fig. 11 Expected test sequence and outcome

图12 测试结果覆盖

Fig. 12 Test result coverage

参考文献 12

[1]	黄晨, 于倩, 左万娟, 等. 基于SysML模型的需求建模及测试方法[J]. 测试技术学报, 2021, 35(2): 93-99.
	HUANG C, YU Q, ZUO W J, et al. Requirement modeling and testing method based on SysML model[J]. Journal of Test and Measurement Technology, 2021, 35(2): 93-99 (in Chinese).
[2]	王飒. SysML活动图模型的测试用例自动生成方法的研究与应用[D]. 重庆: 西南大学, 2022.
	WANG S. Research and application of the test-case automatic generation method of the SysML activity diagram model[D]. Chongqing: Southwest University, 2022 (in Chinese).
[3]	钟思洁. 基于功能需求规格说明的测试用例自动生成方法研究[D]. 长沙: 湖南大学, 2021.
	ZHONG S J. The research on automatic test case generation method based on functional requirement specification[D]. Changsha: Hunan University, 2021 (in Chinese).
[4]	段喜龙, 陆智伟, 郑巍, 等. 面向模型检测的LTL语句自动生成方法[J]. 计算机工程与设计, 2023, 44(8): 2337-2344.
	DUAN X L, LU Z W, ZHENG W, et al. Automatic generation of LTL statements for model checking[J]. Computer Engineering and Design, 2023, 44(8): 2337-2344 (in Chinese).
[5]	PELESKA J. Model-based avionic systems testing for the airbus family[C]// 2018 IEEE 23rd European Test Symposium. New York: IEEE Press, 2018: 1-10.
[6]	EFKEMANN C. A framework for model-based testing of integrated modular avionics[EB/OL]. [2023-11-21]. https://xueshu.baidu.com/usercenter/paper/show?paperid=89f8bc7ab97f86fbee5fcd4f2545e39f&site=xueshu_se.
[7]	MARKUS D, JÖRG B, JAN P. Model-based testing: automatic generation of test cases, test data and test procedures from SysML models[EB/OL]. [2023-11-21]. https://xueshu.baidu.com/usercenter/paper/show?paperid=26ef3ad585738427bfaa9ff2ad3daf13&site=xueshu_se.
[8]	LEE J, KANG S, JUNG P. Test coverage criteria for software product line testing: systematic literature review[J]. Information and Software Technology, 2020, 122: 106272. DOI URL
[9]	陈文杰. 基于UML活动图的测试用例自动生成方法的研究[D]. 北京: 北京交通大学, 2022.
	CHEN W J. Automatic generation of test cases based on UML activity diagram[D]. Beijing: Beijing Jiaotong University, 2022 (in Chinese).
[10]	PUNNOOSE S, NANDA M, ERABHOVI N. An adoption of automation framework for model-based testing to system testing for airborne safety critical systems[C]// 2023 IEEE AUTOTESTCON. New York: IEEE Press, 2023: 1-5.
[11]	刘辉, 杨永凯, 刘中一. 一种测试用例精简与自动生成方法[J]. 甘肃科技, 2022, 38(20): 23-27, 30.
	LIU H, YANG Y K, LIU Z Y. Method for simplifying and automatically generating test cases[J]. Gansu Science and Technology, 2022, 38(20): 23-27, 30 (in Chinese).
[12]	TATALE S, PRAKASH V C. Automatic generation and optimization of combinatorial test cases from UML activity diagram using particle swarm optimization[J]. Ingénierie Des Systèmes d Information, 2022, 27(1): 49-59. DOI URL