Research and Development in Systems Engineering at UMCP

Handout for Northrop Grumman, March 6, 2003

By: Mark Austin, Natasha Kositsyna, Vimal Mayank (...with help from Jeff Coriale)

Table of Contents Contact Information and Project Participants

  1. Major Challenges facing the Practicing Systems Engineer
    • Support for Team Development
    • Synthesis from Modular Components and Subsystems
  2. Our Strategy and Approach to System Development. We promote:
    • Orthogoalization of Design Concerns .....
    • Automation of Multidisciplinary Information-Based Design
  3. Current Project Architecture (NSF, NASA Goddard, Lochheed Martin)
    • Overall Project Architecture
    • Areas of Research Focus: Requirements, Design, and Build
  4. NSF Viewpoint
    • Case Study Framework and Relevant UML Diagrams
    • Requirements Engineering Methodologies and (Semantic Web) Tools
    • Platform-Independent Diagram Editor (XML/RDF)
  5. NASA Goddard Viewpoint
    • Architecture-Level Synthesis and Analysis of a Home Theatre System
    • Writing Requirements and Specifications

Institute for Systems Research,
University of Maryland,
College Park, MD 20742.

Mark's e-mail: austin@isr.umd.edu
Natasha's e-mail: kosnat@isr.umd.edu
Vimal's e-mail: vmayank@isr.umd.edu
Jeff's e-mail: coriale@isr.umd.edu


Current Industry Participants: Lockheed Martin, NASA Goddard Space Flight Center.



Major Challenges Facing the Practicing Systems Engineer

Support for Team Development

  • Teams of experts from multiple disciplines/domains working together on the solution of complex problems is a common requirement in industry today (e.g., integrated product teams (IPTs)). We need to maintain a shared view of the project objectives, and at the same time focus on specific tasks. See Figure 1.

    [System Concerns]

    Figure 1. Elements of Team-Based Development

  • A key challenge is avoiding communication and interpretation problems -- everyone needs to know what they are supposed to be working on, and when it's due!

Synthesis from Modular Components and Subsystems

  • The prevalence of synthesis from modular components is no longer true just for aerospace, defense and large government contracts (systems engineering started with Aerospace Engineering). Instead it is required in all commercial designs and operations. This so-called ``systems integration'' has become key and perhaps the most profitable engineering practice.


Our Strategy and Approach to Systems Engineering Practice

Promote use of Technology-Independent System-Level Design Representations

  • We want to create system-level design representation that are not tied to an underlying implementation technology. This can be achieved, in part, through separate representations for the logical and physical design.

    [Reuse Maturity's]

    Figure 2. Provision for Fomalization and Early Detection of Errors

  • Goal.
    Hardware and software implementations and specific technology selections are ``pushed'' near the very end (i.e., delayed as long as possible), but are performed once and must work flawlessly.

Promote Orthogonalization of Design Concerns -- Function-Architecture Co-Design

  • Emphasize function-architecture co-design. System design alternatives are created by mapping models of system behavior onto tentative system structures. System evaluation and ranking/optimization procedures eliminate the inferior solutions.

    [System Pathway2]

    Figure 3. Evaluation, Ranking, Optimization and Trade-Off Analysis for System Design Alternatives

    Figure 4 shows the primary tracks of traceability for the development of a system-level product.

    Figure 4. Traceability Mappings for the Development Pathway, Goals/Scenarios through Eystem Evaluation.

    For system-level design, traceability begins with the connnection of goals and scenarios with use cases. It links the requirements and specifications with models of system behavior, system structure, and procedures for system evaluation.

    Traceability can also be applied to the sequence of decisions defining the underlying development process, e.g., traceablity of rationale to specific decisions, decisions to actions items ...etc.

  • In the design of complex engineering systems, "orthogonalization of concerns" coupled with mappings and traceablity simplifies the difficulty in exploring the space of design alternatives.

Promote Multi-Representations and Reuse at all levels of Abstraction

  • Abstract multiple disciplines to properly annotated information representations. This is the only way to allow communication among disciplines and multiple contextual views.

    [System Abstraction]

    Figure 5. Layers of Abstraction in Reuse

    A "general-purpose" information representation that can describe all aspects of system behavior and structure is currently unavailable. Hence, systems must work with multiple information abstractions. For example, at high levels of abstraction -- Unified Modeling Language (UML), Technical drawings, Ontologies (Semantic Web). At lower-levels of abstraction -- three dimensional geometric models, engineering simulation packages ... etc.

    Enable reuse of designs, architectures and business processes through object-relational database storage.

    To ensure that the handling of data and information in the synthesis of complex designs is kept in check, it is essential that design domains be modeled with a structure and appropriate level of abstraction that facilitates interpretation, evaluation, and communication of data/information. We want to represent designs in such a way that we can make usefule interpretations of these representations. Deciding what to leave out of a model is just as important as what to include!

    Designers are used to describing the same design in many different ways. Generally it is easier to think in terms of multiple representations (or multiple views) of the same description rather than a canoncical (catch all) descipription from which all other descriptions can be derived. This is appropriate if the different design representations are put to different uses (which, of course, will occur in team-based design).

Promote Automation for Multidisciplinary Information-Based Design

  • We need to find ways to automate the capture and processing of data/information relevant to engineering system development.


Current Project Architecture (NSF, NASA Goddard, Lockheed Martin)

Overall Project Architecture

[Project Architecture]

Figure 7. Current Project Architecture (December, 2002)

Areas of Research Focus: Requirements, Design, and Build

[Current Environment ]

Figure 8. Focus Areas for Current Developemnt: Requirements, Design, and Build

Natasha will talk about capabilities of the editor, and how we work with XML and RDF to create and save high-level system descriptions (i.e., networks of modules connected by ports and cables).

Vimal will talk about RDF and it's capabilities.


NSF Viewpoint (Research and Curriculum Development)

Education: Case Study Framework

We would like all of our case studies to have a common system development and design framework:

  1. Problem Statement
  2. Generation of User Requirements
  3. Simplified Models of System Behavior
  4. Modeling the System Structure
  5. Creating the Logical Design
  6. Creating the Physical Design
  7. Evaluation and Ranking of System Design Alternatives
  8. System Optimization and Tradeoff Analysis
  9. Generalizing the Problem Domain for System Reuse
  10. References and Web Resources

Small Case Study Problems

Small case study problems will be developed by students in the MSSE program.

Classification of UML Diagrams

Major Area View Diagram
System Structure Static View Class Diagram
Use Case View Use Case Diagram
Implementation View Component Diagram
Deployment View Deployment Diagram
System Behavior State Machine View Statechart Diagram
Activity View Activity Diagram
Interaction View Sequence Diagram
Collaboration Diagram

Table 1. Classification of UML Diagrams for each Major Area

Tutorial and Case Study Support Material

Research: Requirements Engineering Methodologies and Tools (April 2002 - present)

  1. Critical Assessment of Present-Day Systems Engineering Tools (e.g., DOORS and SLATE).

    How do we capture and represent knowledge through requirements engineering activities?

    Figure 9. Requirements Engineering Work Breakdown Structure (WBS).

    Figure 10. Requirements Engineering WBS and Industry Toolset Weakensses. (For details, see Ramesh and Jarke, 2001)

    Specific Limitations of Present-Day Tools (Selberg, 2002)

    1. Thick Descriptions.
      Current tools lack the ability to store informal representations (i.e., so-called thick descriptions) of systems conveying information along subtle or implied lines.

    2. Model Driven Trace Capture and Usage.
      Current tools lack mechansms for "easy linking" of models into the design environment (e.g., SLATE).

    3. Abstraction Mechanisms.
      Current tools lack the ability to search and explore requirements at various levels of abstraction.

    4. Inference Services.
      The lack of "inference services" in the work breakdown structure impacts the systems engineering process in several ways. Current tools are incapable of analyzing requirements for completeness or consistency. Search mechanisms are limited to keywords, which can be limiting for custom jargon in multidisciplinary and multilingual projects.

    Observations

    1. The glue that holds the system together is the basic modeling methodology.
    2. The loose coupling between knowlede domains and between CAD applications, and between knowledge repositories supports robust ad-hoc incremental development.
    3. Basic web-based infrastructure, which includes web-servers, application servers, and web browsers is already ubiquitous.

The Semantic Web Layer Cake

Figure 11. The Semantic Web Layer Cake (Berners-Lee, 2002).

The Semantic Web is an extension of the current web.

  1. It aims to give information a well-defined meaning, thereby creating a pathway for machine-to-machine communication and automated serives based on descriptions of semantics.

  2. XML files and web resources capture objects and classes. XML separates structure from presentation.

  3. RDF (resource description framework) describes relationships between objects and classes in a general but simple way. RDF separates content from structure, thereby allowing for the merging of multiple conceptual models.

  4. Ontologies provide a formal conceptualization (semantic representation) of a particular domain shared by a group of people.

  5. Ontology-based applications will be built on top of the Semantic Web infrastructure (i.e., XML, RDF and ontologies)

Transfer of Semantic Web Technologies to Tools for Requirments Engineering

What is the minimum level of Semantic Web Technology that can mitigate (and hopefully overcome) limitations in present-day tools?

Figure 12. Requirements Engineering WBS (Create Branch) to Semantic Layer Cake (Selberg, 2002).

Figure 13. Requirements Engineering WBS (Use Branch) to Semantic Layer Cake (Selberg, 2002).

References

  1. Ramesh B., and Jarke M., "Toward Reference Models for Requirements Traceability," IEEE Transactions on Software Engineering, Vol. 27., No. 1., January 2001, pp. 58-93.
  2. Selberg S., "Requirements Engineering and the Semantic Web," M.S. Thesis, Institute for Systems Research, University of Maryland, College Park, MD 20742, April 2002.

Software Development: Platform-Independent Diagram Editor (June, 2001--present)

Create a click-and-drop editor for development of "Collections of Java-Enabled Diagrams." knowledge capture for systems engineering is enabled through: (1) Diagram annotation features, (2) Links to heterogenous data and information sources on the web, and (3) File (XML/RDF formats) and database storage.

[Integrated Environment ]

Figure 14. Tools and Technologies for Knowledge Capture in Systems Engineering

We are currently working on the right-hand side of this diagram. Future versions of the editor will import of XML representations of diagrams, requirements, and systems stored in commerical databases (e.g., Oracle).


NASA Goddard Viewpoint (Improved SE Methodologies and Tools for GPM)

Medium-Term Objectives and Scope

Explore application of Semantic Web Technologies to the team-based synthesis, visualization, and assessment of system-level architectures for multi-disciplinary spacecraft systems. (3 years work). How do we build thse systems engineering tools? What kinds of new capability are possible?

As a first step, we are studying problems associated with the architecture-level synthesis of a home theatre system.

Computational Support for Bottom-Up Synthesis of Systems, enhanced with Component Reuse

Figure 15 shows elements of a top-down/breadth first development (decomposition) followed by a bottom-up implemenation procedure (composition). In the latter half, a key design decision is: should we custom build new components or buy/reuse them. We envision a library (XML database) of object-specification descriptions.

[System Reuse]

Figure 15. Elements of Top-down and Bottom-Up Development coupled with Component Reuse

The decomposition/composition process proceeds as follows:

System Decomposition

System Composition

The economic benefits of reuse in software are well known. The research challenge we face is how to create a object-specification framework, together with software tools, that will enable reuse across a broader spectrum of engineering systems. Tools are needed for:

Research questions to be answered:

Writing Requirements and Specifications

Requirements and specifications need to be written in a manner that balances two key aspects: (1) they should be readable, and (2) they should lend themselves to various forms of automated processing.

Table 2 summarizes the key features of requirements and specifications.

Requirements
Specifications
Initial requirements are informal, incomplete, and often ambiguous .... Specifications are based upon a detailed knowledge of a product and its capabilities...
The system should ....
The system must ....
The system (input) requirements are ....
The system (output) capabilities are ....
You'll need to make sure .....
Natural language sentences.
  • Pseudo-code. Technical sentences (e.g., written in BNF).
  • UML-like class diagrams for system structure.
  • UML-like FSM/statechart and activity diagrams for system behavior.
  • Equations, charts, tables .....
  • Design rules .....
  • Decision trees....
Validation of requirements supported by traceability to specifications and design subsystems/objects. Verification of specifications supported by formal testing procedures, numerical simulations of system behavior, experiments in the lab ... etc.

Table 2. Comparison of Requirements and Specifications

Organizing requirements into the right structure can help:

Attaching Specifications to Objects/Components

An object-specification pair defines a set of behaviors can be offered by a component/object.

[Elements of an Object-Specification Pair]

Figure 16. Elements of an Object-Specification Pair.

Object/component descriptions must be at least multi-input multi-output (MIMO). Otherwise they aren't useful.

Research
Research questions to be answered:

Example: Architecture-Level Synthesis and Analysis of a Home Theatre System

System-level design of the "home theatre system" requires top-down decompositions of goals into layers of requirements, followed by a bottom-up implementation of the system from theatre components.

We would like to create and interactive design environment where the specifications for components are found on the web.

[Architecture2]

Figure 17. Synthesis of System Architectures Supported by Product Descriptions on Web

Figure 16 shows a simple scenario:

Top-Down System-Level Development Coupled with Component Reuse

Design Goal
I need a home theatre system.

Operations Concept
Our wishes are very modest -- we will simply watch DVD movies on a large size theatre screen and high fidelity audio system.

[Requirements to Architecture]

Figure 18. Flowdown of Requirements to System Architecture. Reuse of System Components.

Pathway from Goals/Scenarios to Requirements

Level 1 Requirements
  • I need a home theatre system.
  • The total cost must be less than or equal to US $8,000.
Level 2 Requirements
Level 3 Requirements

Visual Display

  • The theatre system shall have a large display screen.
  • Cost of the "visual display" shall not exceed US $7,000.
  • The display should enable picture clarity from a wide range of viewing angles.
  • The display must be thin enough to be mounted on a wall.


Audio System

  • The system shall have a high fidelity audio system.
  • Cost of the "audio system" shall not exceed US $1,000.

Flatscreen TV

  • Cost of the flatscreen TV system < US $7000.00
  • Geometry of the screen shall be at least 3 ft by 4 ft.
  • The screen thickness shall be no more than 6 inches.
  • Interface requirements -- to be determined.


Amplifier System

  • Cost of the amplifier system < US $400.00
  • The audio system output shall be at least 200 watts, but no more than 300 watts.
  • Interface requirements -- to be determined.

Speaker System

  • Cost of the speaker system < US $600.00
  • Capacity of the speaker system output shall be at least 350 watts.
  • Interface requirements -- to be determined.

Our course of action will be to represent requirements knowledge in terms of facts and logical rules, and to implement control tasks separately.

Research questions to be answered:

Representation of System Architecture
The system architecture is the structure of the pieces that make up a system, including the resposibilities of the pieces and their interconnection.

In many applications, the spatial configuration of elements is an important consideration. Hence, there is a need for representations that capture the size, location, and relative positioning of objects. Of course, allowable positioning of objects will depend on the properties of the objects themselves.

To keep the complexity of evaluation in check, designs are organized into abstraction hierarchies.

Research questions to be answered:

Interface Requirements/Specifications

Insert ....

Hybrid (Symbolic/Instantiated) Represenation for System Architecture

Insert ....

Library of Product (Amplifier Object) Descriptions

We envision an XML database containing collections of object-specification pairs. Research questions to be answered:

A model-based system should be able to handle a wide range of designer-intiated queries, and anticipate queries based on information in the design knowledge base. Many features of a design can be inferred its explicity description -- since much of this information may not be relevant to a particular set of decisions, there must be some strategy to guide the interpretation process. Generally this can be achieved by setting up interpretation goals -- statements whose truth we wish to test against the design description.

Allocation of Objects (Product Descriptions) to Subsystem Elements

Research questions to be answered:


Print Version. March 14, 2003. [Left] [Up] [Right]