System software
System software
Text Books:
Leland L Beck and D. Manjula, "System Software",III Edition, Pearson Education , First
Impression, 2007.
John J Donovan, Systems Programming, Tata McGraw Hill Company, New Delhi, 2004.
Alfred V. Aho, Monica S. Lam, Ravi Sethi, Jeffrey D. Ullman, Compilers: Principles,
Techniques, & Tools, 2nd edition Addison-Wesley, 2006.
Reference Books:
Dhamdhere D M, Systems Programming and Operating Systems, Tata McGraw Hill
Company, New Delhi, 2002.
David Galles, Modern Compiler Design, Addison Wesley, 2004.
Websites:
http://www.edunotes.in/system-software-notes
http://www.uotechnology.edu.iq/sweit/Lectures/Dr-Shaima-Sys-Prog/lec1-2-3-4.pdf
1
IT T46 SYSTEM SOFTWARE
TABLE OF CONTENTS
1. Machine Architecture
1.1 Introduction 04
1.2 System Software and Machine Architecture 04
1.3 Simplified Instructional Computer (SIC) 04
1.3.1 SIC Machine Architecture 05
1.3.2 SIC Programming Examples 07
1.3.3 SIC/XE Machine Architecture 09
1.4 VAX Architecture 13
1.5 Pentium Pro Architecture 15
1.6 RISC Machines 17
2. Assemblers
2.1 Basic Assembler Function 25
2.1.1 A Simple SIC Assembler 29
2.1.2Assembler Algorithm and Data Structures 30
2.2 Machine Dependent Assembler Features 36
2.2.1 Instruction Formats & Addressing Modes 36
22.2. Program Relocation. 40
2.3 Machine Independent Assembler Features 42
2.3.1 Literals
2.3.2 Symbol-Definition Statements
2.3.3 Expression, Program Blocks
2.3.4 Control Sections and Programming Linking
2.4 Assembler Design Operations 59
2.4.1 One-Pass Assembler 59
2.4.2 Multi-Pass Assembler 63
2.5 Interpreters 65
2.5.1 Java Virtual Machine Concepts 65
2.5.2 Java Byte Codes 68
2.5.3 Microsoft Intermediate Language 70
3. Loaders and Linkers
3.1 Basic Loader Functions 77
3.1.1 Design of an Absolute Loader 78
3.1.2 A Simple Bootstrap Loader 80
2
IT T46 SYSTEM SOFTWARE
4. Macro Processor
4.1 Basic Macro Processor Functions 103
4.1.1 Macro Definitions and Expansion 103
4.1.2 Macro Processor Algorithm and Data Structures 106
4.2 Machines-Independent Macro Processor Features 113
4.2.1 Concatenation of Macro Parameters 113
4.2.2 Generation of Unique Labels 114
4.2.3 Conditional Macro Expansion 116
4.2.4 Keyword Macro Parameters
4.3 Macro Processor Design Options 122
4.3.1 Recursive Macro Expansion 122
4.3.2 General-Purpose Macro Processors 123
4.3.3 Macro Processing Within Language Translators 124
4.4 Line by Line Macro Processor 124
3
IT T46 SYSTEM SOFTWARE
UNIT-I
Introduction to System Software and Machine architecture – Simplified Instructional Computer
(SIC)-Traditional machines-VAX Architecture-Pentium Pro Architecture- RISC machines.
1.1 INTRODUCTION
SYSTEM SOFTWARE
The Software is set of instructions or programs written to carry out certain task on digital
computers. It is classified into system software and application software. System software consists of a
variety of programs that support the operation of a computer. Application software focuses on an
application or problem to be solved. System software consists of a variety of programs that support the
operation of a computer.
Examples for system software are Operating system, compiler, assembler, macro processor,
loader or linker, debugger, text editor, database management systems (some of them) and, software
engineering tools. These software’s make it possible for the user to focus on an application or other
problem to be solved, without needing to know the details of how the machine works internally.
4
IT T46 SYSTEM SOFTWARE
Memory
There are 215 bytes in the computer memory, which is 32,768 bytes. It uses Little Endian format to
store the numbers, 3 consecutive bytes form a word, and each location in memory contains 8-bit bytes.
Registers:
There are five registers, each 24 bits in length. Their mnemonic, number and use are given in the
following table.
Data Formats:
Integers are stored as 24-bit binary numbers. 2’s complement representation is used for negative values,
characters are stored using their 8-bit ASCII codes. No floating-point hardware on the standard version
of SIC.
Addressing Modes:
5
IT T46 SYSTEM SOFTWARE
There are two addressing modes available, which are as shown in the above table. Parentheses
are used to indicate the contents of a register or a memory location.
Instruction Set
SIC provides, load and store instructions (LDA, LDX, STA, STX, etc.). Integer arithmetic
operations: (ADD, SUB, MUL, DIV, etc.).
All arithmetic operations involve register A and a word in memory, with the result being
left in the register. Two instructions are provided for subroutine linkage.
COMP compares the value in register A with a word in memory, this instruction sets a
condition code CC to indicate the result. There are conditional jump instructions: (JLT, JEQ, JGT),
these instructions test the setting of CC and jump accordingly.
JSUB jumps to the subroutine placing the return address in register L, RSUB returns by
jumping to the address contained in register L.
LDA, STA, LDL, STL, LDX, STX (A- Accumulator, L – Linkage Register, X – Index
Register), all uses3-byte word. LDCH, STCH associated with characters uses 1-byte. There are no
memory-memory move instructions.
Storage definitions are
WORD - ONE-WORD CONSTANT
6
IT T46 SYSTEM SOFTWARE
7
IT T46 SYSTEM SOFTWARE
STR2 RESB 11
ZERO WORD 0
ELEVEN WORD 11
Example 5: To transfer two hundred bytes of data from input device to memory
LDX ZERO
CLOOP TD INDEV
JEQ CLOOP
RD INDEV
STCH RECORD, X
TIX B200
JLT CLOOP
.
.
INDEV BYTE X ‘F5’
RECORD RESB 200
ZERO WORD 0
B200 WORD 200
8
IT T46 SYSTEM SOFTWARE
Memory
Registers
Instruction Formats
The new set of instruction formats for SIC/XE machine architecture are as follows.
Format 1 (1 byte): contains only operation code (straight from table).
Format 2 (2 bytes): first eight bits for operation code, next four for register 1 and following
four for register 2. The numbers for the registers go according to the numbers indicated at the
registers section (ie, register T is replaced by hex 5, F is replaced by hex 6).
Format 3 (3 bytes): First 6 bits contain operation code, next 6 bits contain flags, last 12 bits
contain displacement for the address of the operand. Operation code uses only 6 bits, thus the
second hex digit will be affected by the values of the first two flags (n and i). The flags, in
order, are: n, i, x, b, p, and e. its functionality is explained in the next section. The last flag e
indicates the instruction format (0 for 3 and 1 for 4).
9
IT T46 SYSTEM SOFTWARE
Format 4 (4 bytes): same as format 3 with an extra 2 hex digits (8 bits) for addresses that require
more than 12 bits to be represented.
Format 1 (1 byte)
8
op
Format 2 (2 bytes)
Formats 1 and 2 are instructions do not reference memory at all
8 4 4
op r1 r2
Format 3 (3 bytes)
6 1 1 1 1 1 1 12
op n i x b p e disp
Format 4 (4 bytes)
6 1 1 1 1 1 1 20
Op n i x b p e address
10
IT T46 SYSTEM SOFTWARE
Indirect (i = 0, n = 1): The operand value points to an address that holds the address for the operand
value.
Indexed (x = 1): value to be added to the value stored at the register x to obtain real address of the
operand. This can be combined with any of the previous modes except immediate mode.
The various flag bits used in the above formats have the following meanings
e - > e = 0 means format 3, e = 1 means format 4.
Bits x, b, p: Used to calculate the target address using relative, direct, and indexed addressing
Modes.
Bits i and n: Says, how to use the target address.
b and p - both set to 0, disp field from format 3 instruction is taken to be the target address. For a
format 4 bits b and p are normally set to 0, 20 bit address is the target address
x - x is set to 1, X register value is added for target address calculation
i=1, n=0 Immediate addressing, TA: TA is used as the operand value, no memory reference
i=0, n=1 Indirect addressing, ((TA)): The word at the TA is fetched. Value of TA is taken as the
address of the operand value
i=0, n=0 or i=1, n=1 simple addressing, (TA): TA is taken as the address of the operand value. Two
new relative addressing modes are available for use with instructions assembled using format
3.
Instruction Set
SIC/XE provides all of the instructions that are available on the standard version. In addition
we have, Instructions to load and store the new registers LDB, STB, etc, Floating-point arithmetic
operations, ADDF, SUBF, MULF, DIVF, Register move instruction: RMO, Register-to-register
arithmetic operations, ADDR, SUBR, MULR, DIVR and, Supervisor call instruction : SVC.
11
IT T46 SYSTEM SOFTWARE
There are I/O channels that can be used to perform input and output while the CPU is executing other
instructions. Allows overlap of computing and I/O, resulting in more efficient system operation. The
instructions SIO, TIO, and HIO are used to start, test and halt the operation of I/O channels. Example
Programs (SIC/XE)
LDA #5
STA ALPHA
LDA #90
STCH C1
.
.
ALPHA RESW 1
C1 RESB 1
LDS INCR
LDA ALPHA
ADD S, A
SUB #1
STA BETA
………….
…………..
ALPHA RESW 1
BETA RESW 1
INCR RESW 1
LDT #11
LDX #0 :X=0
MOVECH LDCH STR1, X : LOAD A FROM STR1
12
IT T46 SYSTEM SOFTWARE
The VAX family of computer was introduced by Digital Equipment Corporation in 1978.
A compatibility mode was provided at the hardware level so the many PDP – II program
could run unchanged on the VAX.
16 general-purpose registers
R0-R11: no special functions
R12 - AP: argument pointer (address of arguments when making a procedure
call)
FP: frame pointer (address of the stack frame when making a procedure call)
R14 - SP: stack pointer (top of stack in program’s process space)
R15 - PC: program counter
PSL: processor status long word
Control registers to support OS
13
IT T46 SYSTEM SOFTWARE
Data formats
– Characters: 8-bit ASCII codes
– Integers:
2, 4, 8, 16-byte binary numbers
2’s complement for negative values
– Floating-point numbers:
4 different floating-point data ranging in length from 4 to 16 bytes
– Packed decimal data format
Each byte represents two decimal digits
– Numeric format
To represent numeric values with one digit per byte
– Queues and variable-length bit strings
– VAX processor provide a packed decimal data format in each byte represent two
decimal digit, which each digit encoded using 4 bits of the byte.
– The sign is encoded in the last 4 bits
Instruction formats
– Variable-length instruction format
– Each instruction consists of
OP code (1 or 2 bytes)
Up to 6 operand specifiers (depends on instruction)
Addressing modes
– Register mode
– Register deferred mode
– Auto increment and auto decrement modes
– Base relative modes
– PC relative modes
– Index modes
– Indirect modes
– Immediate mode
Instruction set
– Mnemonics format (e.g., ADDW2, MULL3)
Prefix: type of operation
Suffix: data type of the operands
Modifier: number of operands involved
14
IT T46 SYSTEM SOFTWARE
– Each I/O device has a set of registers, which are assigned locations in the physical
address space, called I/O space.
– Association of these registers with addresses in I/O space is handled by memory
management routines.
– Device driver read/write values into these registers.
– Software routines read/write values in I/O space using standard instructions.
Introduction
The Pentium pro architecture is introduced near the end of 1995. Is the latest in the Intel X86
families, other recent microprocessors in this family are 80486 and Pentium Processors of the x86
family are presented used in a majority of personal computer, and there is a vast amount of software for
this processor
15
IT T46 SYSTEM SOFTWARE
Data formats
– The x86 architecture provided for the storage of integer floating point value character
and strings.
– Characters: 8-bit ASCII codes
– Integers:
1, 2, 4-byte binary numbers (8-byte signed integers for FPU)
2’s complement for negative values
Little-endian byte ordering
Binary coded decimal (packed or unpacked BCD)
– Floating-point numbers:
Single-precision: 32 bits
Double-precision: 64 bits
Extended-precision: 80 bits
– The single Pentium format 32 bit long. It store 24 significant bit of floating point value
and allow for 7 bit exponent
– The double precision format 64-bit long. It store 53 significant bit of floating point
value and allow for 10 bit exponent.
Instruction formats
– Variable-length instruction format (1-10 bytes)
– Each instruction consists of
Optional prefixes containing flags that modify the operation of the instruction
E.g., repetition count, segment register specification
OP code (1 or 2 bytes)
A number of bytes for operands and addressing modes
16
IT T46 SYSTEM SOFTWARE
Addressing modes
– The x86 architecture provides a large number of addressing mode. An operand value
may be specified as part of the instruction itself or it may be register
– Immediate mode
– Register mode
– Base relative mode
– PC relative mode
– Index mode
– Direct mode
– Etc
– Operands stored memory often specified using variation of general target address
calculation.
– TA = (base register) + (index register) * (scale factor) + displacement
The ULTRA SPARC processor announced by sun micro system in 1995, is latest
member of SPARC family other member of this family include a variety SPARC and super SPARC
processors.
17
IT T46 SYSTEM SOFTWARE
The original SPARC Architecture developed in mid 1980s, and has been implemented
by a number of manufacturers. The name SPARC stands for Scalable Processor ARChitecture.
Data formats
– The ultra SPARC architecture provides for storage integer floating point value and
characters.
– Characters: 8-bit ASCII codes
– Integers:
1, 2, 4, 8-byte binary numbers
2’s complement for negative values
18
IT T46 SYSTEM SOFTWARE
Addressing modes
– Immediate mode
– Register direct mode
– PC relative mode only for branch instructions
– Register indirect with displacement
– Register indirect indexed
19
RISC MACHINE-POWER PC ARCHITECTURE
• Memory
» halfword, word, doubleword, quadword
» may instructions may execute more efficiently if operands are aligned at a
starting address that is a multiple of their length
» virtual space 264 bytes
» fixed-length segments, 256 MB
» fixed-length pages, 4KB
» MMU: virtual address -> physical address
• Registers
» 32 general-purpose registers, GPR0~GPR31
» FPU
» condition code register reflects the result of certain operations, and can be used
as a mechanism for testing and branching
» Link Register (LR) and Count Register (CR) are used by some branch
instructions
» Machine Status Register (MSR)
• Data Formats
» integers are 8-, 16-, 32-, 64-bit binary numbers
» 2’s complement is used for negative values
» support both big-endian (default) and little-endian byte orderings
» three different floating-point data formats
l single-precision, 32 bits long (23 + 8 + 1)
l double-precision, 64 bits long (52 + 11 + 1)
» characters are stored using 8-bit ASCII codes
• Seven Instruction Formats
» 32 bits long
» the first 6 bits identify specify the opcode
» some instruction have an additional extended opcode
» the complexity is greater than SPARC
» fixed-length makes decoding faster and simple than VAX and x86
• Addressing Modes
» immediate mode, register direct mode
» memory addressing
Mode Target address calculation
Register indirect TA=(register)
Register indirect with indexed TA=(register-1)+(register-2)
Register indirect with TA=(register)+displacement {16 bits,
signed}immediate indexed
» branch instruction
» Mode Target address calculation
Absolute TA= actual address
Relative TA= current instruction address +
displacement {25 bits, signed}
Link Register TA= (LR)
Count Register TA= (CR)
• Instruction Set
» 200 machine instructions
– more complex than most RISC machines
– e.g. floating-point “multiply and add” instructions that take three input
operands
– e.g. load and store instructions may automatically update the index
register to contain the just-computed target address
» pipelined execution
– more sophisticated than SPARC
» branch prediction
• Input and Output
» two different modes
– direct-store segment: map virtual address space to an external address
space
– normal virtual memory access
CRAY T3E ARCHITECTURE
• T3E
» 16~2048 processing elements (PE)
» three-dimensional network
» each PE consists of a DEC Alpha EV5 RISC microprocessor, local memory,
and performance-accelerating control logic.
• Local Memory
» 64MB ~ 2GB
» physically distributed, logically shared memory
» byte, word, longword, quadword
» 64-bit virtual addresses
• Registers
» 32 general-purpose registers, GPR0~GPR31
» 32 floating-point registers, F0~F31
▪ F31 always contain the value zero
» program counter PC
» other status and control registers
\
IT T46 SYSTEM SOFTWARE
4. Define loader.
Loader is a set of program that loads the machine language translated by the translator into the
main memory and makes it ready for execution.
It is a 6 byte instruction used to move L+I bytes data from the storage location1 to the storage
location2.
Storage location1 = D1+ [B1]
Storage location2 = D2+ [B2]
Eg: MOV 60,400(3), 500(4)
20
IT T46 SYSTEM SOFTWARE
7. Give any two difference between base relative addressing and program counter relative
addressing used in SIC/XE.
Here 6 is the immediate data and the next value is indirect data.ie the register contains the
address of the operand. Here the address of the operand is 5 and its corresponding value is 7.
6 + [R] = 6+ [5] = 6+ 7 =13
21
IT T46 SYSTEM SOFTWARE
12. What is the name of X and L register in SIC machine and also specify its
use. A-accumulator
Used for arithmetic operation.ie in the case of arithmetic operations one operand is in the
Accumulator and other operand may be an immediate value, register operand or memory content. The
operation given in the instruction is performed and the result is stored in the accumulator register.
L-linkage register
It is used to store the return address in the case of jump to subroutine (JSUB) instructions.
13. What are the instruction formats used in SIC/XE architecture? Give any one format.
Format 1 (1 byte), Format 2 (2 bytes), Format 3 (3 bytes) & Format 4(4 bytes)
Are the different instructions used in SIC/XE
architecture? Format 2:
16. What is the difference between the instructions LDA # 3 and LDA THREE?
In the first instruction immediate addressing is used. Here the value 3 is directly loaded into the
accumulator register.
In the second instruction the memory reference is used. Here the address (address assigned for
the symbol THREE) is loaded into the accumulator register.
22
IT T46 SYSTEM SOFTWARE
How do you calculate the actual address in the case of register indirect with immediate index
mode?
Here the target address is calculated using the formula
T.A = (register) + displacement.
Write the sequence of instructions to perform the operation BETA = ALPHA + 1 using SIC
instructions.
Write the sequence of instructions to perform the operation BETA = ALPHA+5 using SIC/XE
instructions.
23
IT T46 SYSTEM SOFTWARE
24
IT T46 SYSTEM SOFTWARE
Unit-II
Assemblers: Basic assembler functions- machine – dependent and machine independent assembler
features – Assembler design – Two-pass assembler with overlay structure- one – pass assembler and
multi - pass assembler. Interpreters: Virtual Machine concept- Java Byte Codes- Microsoft
Intermediate Language
So for the design of the assembler we need to concentrate on the machine architecture of
the SIC/XE machine. We need to identify the algorithms and the various data structures to be used.
According to the above required steps for assembling the assembler also has to handle
25
IT T46 SYSTEM SOFTWARE
assembler directives, these do not generate the object code but directs the assembler to perform
certain operation. These directives are:
The assembler design can be done:
Single pass assembler
Multi-pass assembler
Single-pass Assembler
In this case the whole process of scanning, parsing, and object code conversion is done in
single pass. The only problem with this method is resolving forward reference. This is shown with
an example below:
10 1000 FIRST STL RETADR 141033
--
--
--
--
95 1033 RETADR RESW 1
In the above example in line number 10 the instruction STL will store the linkage register
with the contents of RETADR. But during the processing of this instruction the value of this symbol
is not known as it is defined at the line number 95. Since I single-pass assembler the scanning,
parsing and object code conversion happens simultaneously. The instruction is fetched; it is
scanned for tokens, parsed for syntax and semantic validity. If it valid then it has to be converted
to its equivalent object code. For this the object code is generated for the opcode STL and the value
for the symbol RETADR need to be added, which is not available.
Due to this reason usually the design is done in two passes. So a multi-pass assembler
resolves the forward references and then converts into the object code. Hence the process of the
multi-pass assembler can be as follows:
Pass-1
Assign addresses to all the statements
Perform some processing of assembler directives such as RESW, RESB to find the length of
data areas for assigning the address values.
26
IT T46 SYSTEM SOFTWARE
Pass-2
Assemble the instructions (translating operation codes and looking up addresses).
Perform the processing of the assembler directives not done during pass-1.
Assembler Design:
The most important things which need to be concentrated is the generation of Symbol
table and resolving forward references.
Symbol Table
This is created during pass 1
There will not be any address value for such symbols in the symbol table in pass 1.
Example Program
The example program considered here has a main module, two subroutines
Purpose of example program
Reads records from input device (code F1)
Copies them to output device (code 05)
At the end of the file, writes EOF on the output device, then RSUB to the operating system
Data transfer (RD, WD)
A buffer is used to store record
Buffering is necessary for different I/O rates
The end of each record is marked with a null character (00)16
The end of the file is indicated by a zero-length record
Subroutines (JSUB, RSUB)
RDREC, WRREC
-Save link register first before nested jump
27
IT T46 SYSTEM SOFTWARE
The first column shows the line number for that instruction, second column shows the addresses
allocated to each instruction. The third column indicates the labels given to the statement, and is
followed by the instruction consisting of opcode and operand. The last column gives the equivalent
object code.
The object code later will be loaded into memory for execution. The simple object program we
use contains three types of records:
Header record
Col. 1 H
Col. 2~7 Program name
Col. 8~13 Starting address of object program (hex)
Col. 14~19 Length of object program in bytes (hex)
Text record
Col. 1 T
Col. 2~7 Starting address for object code in this record (hex).
Col. 8~9 Length of object code in this record in bytes (hex)
Col.1 E
Col.2~7 Address of first executable instruction in object program (hex) “^” is only for
separation only
28
IT T46 SYSTEM SOFTWARE
The program below is shown with the object code generated. The column named LOC gives
the machine addresses of each part of the assembled program (assuming the program is starting at
location 1000). The translation of the source program to the object program requires us to accomplish
the following functions:
Convert the mnemonic operation codes to their machine language equivalent.
Convert the data constants specified in the source program into their internal machine
representations in the proper format.
All these steps except the second can be performed by sequential processing of the source
program, one line at a time. Consider the instruction
In addition to the translation to object program, the assembler has to take care of handling
assembler directive. These directives do not have object conversion but gives direction to the
assembler to perform some function. Examples of directives are the statements like BYTE and
WORD, which directs the assembler to reserve memory locations without generating data values.
The other directives are START which indicates the beginning of the program and END indicating
the end of the program.
The assembled program will be loaded into memory for execution. The simple object
program contains three types of records: Header record, Text record and end record. The header
record contains the starting address and length. Text record contains the translated instructions and
data of the program, together with an indication of the addresses where these are to be loaded. The
end record marks the end of the object program and specifies the address where the execution is to
begin.
29
IT T46 SYSTEM SOFTWARE
The assembler can be designed either as a single pass assembler or as a two pass assembler.
The general description of both passes is as given below:
Perform assembler directives, including those for address assignment, such as BYTE and
RESW
Pass 2 (assemble instructions and generate object program)
Assemble instructions (generate opcode and look up addresses)
30
IT T46 SYSTEM SOFTWARE
OPTAB
It is used to lookup mnemonic operation codes and translates them to their machine language
equivalents. In more complex assemblers the table also contains information about instruction
format and length.
In pass 1 the OPTAB is used to look up and validate the operation code in the source program. In
pass 2, it is used to translate the operation codes to machine language. In simple SIC machine
this process can be performed in either in pass 1 or in pass 2. But for machine like SIC/XE that
has instructions of different lengths, we must search OPTAB in the first pass to find the
instruction length for incrementing LOCCTR.
In pass 2 we take the information from OPTAB to tell us which instruction format to use in
assembling the instruction, and any peculiarities of the object code instruction.
OPTAB is usually organized as a hash table, with mnemonic operation code as the key. The hash
table organization is particularly appropriate, since it provides fast retrieval with a minimum of
searching. Most of the cases the OPTAB is a static table- that is, entries are not normally added
to or deleted from it. In such cases it is possible to design a special hashing function or other
data structure to give optimum performance for the particular set of keys being stored.
SYMTAB
This table includes the name and value for each label in the source program, together with flags to
indicate the error conditions (e.g., if a symbol is defined in two different places).
During Pass 1: labels are entered into the symbol table along with their assigned address value as they
are encountered. All the symbols address value should get resolved at the pass 1.
During Pass 2: Symbols used as operands are looked up the symbol table to obtain the address
value to be inserted in the assembled instructions.
SYMTAB is usually organized as a hash table for efficiency of insertion and retrieval. Since
entries are rarely deleted, efficiency of deletion is the important criteria for optimization.
Both pass 1 and pass 2 require reading the source program. Apart from this an intermediate file is
created by pass 1 that contains each source statement together with its assigned address, error
indicators, etc. This file is one of the inputs to the pass 2.
A copy of the source program is also an input to the pass 2, which is used to retain the operations
that may be performed during pass 1 (such as scanning the operation field for
31
IT T46 SYSTEM SOFTWARE
symbols and addressing flags), so that these need not be performed during pass 2. Similarly,
pointers into OPTAB and SYMTAB is retained for each operation code and symbol used. This
avoids need to repeat many of the table-searching operations.
LOCCTR
Apart from the SYMTAB and OPTAB, this is another important variable which helps in the
assignment of the addresses. LOCCTR is initialized to the beginning address mentioned in the START
statement of the program. After each statement is processed, the length of the assembled instruction is
added to the LOCCTR to make it point to the next instruction. Whenever a label is encountered in an
instruction the LOCCTR value gives the address to be associated with that label.
Begin
read first input line
if OPCODE = ‘START’ then begin
save #[Operand] as starting addr
initialize LOCCTR to starting address
write line to intermediate file
read next line
end( if START)
else
initialize LOCCTR to 0
While OPCODE != ‘END’ do
begin
if this is not a comment line then
begin
if there is a symbol in the LABEL field then
begin
search SYMTAB for LABEL
if found then
set error flag (duplicate symbol)
else
(if symbol)
search OPTAB for OPCODE
if found then
add 3 (instr length) to LOCCTR
32
IT T46 SYSTEM SOFTWARE
The algorithm scans the first statement START and saves the operand field (the address) as the
starting address of the program. Initializes the LOCCTR value to this address. This line is
written to the intermediate line.
If the symbol already exists that indicates an entry of the same symbol already exists. So an error
flag is set indicating a duplication of the symbol.
It next checks for the mnemonic code, it searches for this code in the OPTAB. If found then the
length of the instruction is added to the LOCCTR to make it point to the next instruction.
If the opcode is the directive WORD it adds a value 3 to the LOCCTR. If it is RESW, it needs to
add the number of data word to the LOCCTR. If it is BYTE it adds a value one to the LOCCTR,
if RESB it adds number of bytes.
33
IT T46 SYSTEM SOFTWARE
If it is END directive then it is the end of the program it finds the length of the program by evaluating
current LOCCTR – the starting address mentioned in the operand field of the END directive.
Each processed line is written to the intermediate file.
34
IT T46 SYSTEM SOFTWARE
Here the first input line is read from the intermediate file. If the op code is START, then this
line is directly written to the list file. A header record is written in the object program which gives the
starting address and the length of the program (which is calculated during pass 1). Then the first text
record is initialized. Comment lines are ignored. In the instruction, for the op code the OPTAB is
searched to find the object code.
If a symbol is there in the operand field, the symbol table is searched to get the address value
for this which gets added to the object code of the op code. If the address not found then zero value is
stored as operands address. An error flag is set indicating it as undefined. If symbol itself is not found
then store 0 as operand address and the object code instruction is assembled.
If the op code is BYTE or WORD, then the constant value is converted to its equivalent object
code (for example, for character EOF, its equivalent hexadecimal value ‘454f46’ is stored). If the object
code cannot fit into the current text record, a new text record is created and the rest of the instructions
object code is listed. The text records are written to the object program. Once the whole program is
assemble and when the END directive is encountered, the End record is written.
35
IT T46 SYSTEM SOFTWARE
Program relocation.
2 byte instruction
3 byte instruction
4 byte instruction
Instructions can be
Instructions involving register to register
Instructions with one operand in memory, the other in Accumulator (Single operand instruction)
PC-relative: Opcode m
36
IT T46 SYSTEM SOFTWARE
with the mnemonics object code. If required a separate table can be created with the register names and
their equivalent numeric values.
2. Translation involving Register-Memory instructions
In SIC/XE machine there are four instruction formats and five addressing modes. For formats
and addressing modes
Among the instruction formats, format -3 and format-4 instructions are Register-Memory type of
instruction. One of the operand is always in a register and the other operand is in the memory. The
addressing mode tells us the way in which the operand from the memory is to be fetched.
There are two ways: Program-counter relative and Base-relative. This addressing mode can be
represented by either using format-3 type or format-4 type of instruction format. In format-3, the
instruction has the opcode followed by a 12-bit displacement value in the address field. Where as in
format-4 the instruction contains the mnemonic code followed by a 20-bit displacement value in the
address field.
Program-Counter Relative
In this usually format-3 instruction format is used. The instruction contains the opcode followed
by a 12-bit displacement value.
The range of displacement values are from 0 -2048. This displacement (should be small enough
to fit in a 12-bit field) value is added to the current contents of the program counter to get the target
address of the operand required by the instruction.
This is relative way of calculating the address of the operand relative to the program counter.
Hence the displacement of the operand is relative to the current program counter value. The following
example shows how the address is calculated:
In this mode the base register is used to mention the displacement value. Therefore
the target address is
TA = (base) + displacement value
37
IT T46 SYSTEM SOFTWARE
This addressing mode is used when the range of displacement value is not sufficient. Hence the
operand is not relative to the instruction as in PC-relative addressing mode. Whenever this
mode is used it is indicated by using a directive BASE.
The moment the assembler encounters this directive the next instruction uses base-relative
addressing mode to calculate the target address of the operand.
When NOBASE directive is used then it indicates the base register is no more used to calculate the
target address of the operand. Assembler first chooses PC-relative, when the displacement field
is not enough it uses Base-relative.
For example
12 0003 LDB #LENGTH 69202D
13 BASE LENGTH
::
100 0033 LENGTH RESW 1
105 0036 BUFFER RESB 4096
::
160 104E STCH BUFFER, X 57C003
165 1051 TIXR T B850
In the above example the use of directive BASE indicates that Base-relative addressing mode
is to be used to calculate the target address. PC-relative is no longer used. The value of the LENGTH
is stored in the base register. If PC-relative is used then the target address calculated is:
The LDB instruction loads the value of length in the base register which 0033. BASE directive
explicitly tells the assembler that it has the value of LENGTH.
::
175 1056 EXIT STX LENGTH 134000
38
IT T46 SYSTEM SOFTWARE
If the symbol is referred in the instruction as the immediate operand then it is immediate with PC-
relative mode as shown in the example below:
The
39
IT T46 SYSTEM SOFTWARE
instruction jumps the control to the address location RETADR which in turn has the address of the
operand. If address of RETADR is 0030, the target address is then 0003 as calculated above.
Absolute Program
In this the address is mentioned during assembling itself. This is called Absolute Assembly.
Consider the instruction:
55 101B LDA THREE 00102D
This statement says that the register A is loaded with the value stored at location 102D. Suppose it
is decided to load and execute the program at location 2000 instead of location 1000.
Then at address 102D the required value which needs to be loaded in the register A is no more
available. The address also gets changed relative to the displacement of the program. Hence we
need to make some changes in the address portion of the instruction so that we can load and
execute the program at location 2000.
Apart from the instruction which will undergo a change in their operand address value as the
program load address changes. There exist some parts in the program which will remain same
regardless of where the program is being loaded.
Since assembler will not know actual location where the program will get loaded, it cannot
make the necessary changes in the addresses used in the program. However, the assembler
identifies for the loader those parts of the program which need modification.
An object program that has the information necessary to perform this kind of modification is
called the relocatable program.
40
IT T46 SYSTEM SOFTWARE
The above diagram shows the concept of relocation. Initially the program is loaded at location
0000. The instruction JSUB is loaded at location 0006.
The address field of this instruction contains 01036, which is the address of the instruction labeled
RDREC. The second figure shows that if the program is to be loaded at new location 5000.
The address of the instruction JSUB gets modified to new location 6036. Likewise the third figure
shows that if the program is relocated at location 7420, the JSUB instruction would need to be
changed to 4B108456 that correspond to the new address of RDREC.
The only part of the program that require modification at load time are those that specify direct
addresses. The rest of the instructions need not be modified. The instructions which doesn’t
require modification are the ones that is not a memory address (immediate addressing) and PC-
relative, Base-relative instructions.
From the object program, it is not possible to distinguish the address and constant the assembler
must keep some information to tell the loader. The object program that contains the
modification record is called a relocatable program.
For an address label, its address is assigned relative to the start of the program (START 0). The
assembler produces a Modification record to store the starting location and the length of
41
IT T46 SYSTEM SOFTWARE
the address field to be modified. The command for the loader must also be a part of the object
program. The Modification has the following format:
Modification record
Col. 1 M
Col. 2-7 Starting location of the address field to be modified, relative to the beginning of the
program (Hex)
Col. 8-9 Length of the address field to be modified, in half-bytes (Hex)
One modification record is created for each address to be modified The length is stored in half-
bytes (4 bits) The starting location is the location of the byte containing the leftmost bits of the address
field to be modified. If the field contains an odd number of half-bytes, the starting location begins in
the middle of the first byte.
In the above object code the red boxes indicate the addresses that need modifications. The
object code lines at the end are the descriptions of the modification records for those instructions which
need change if relocation occurs. M00000705 is the modification suggested for the statement at location
0007 and requires modification 5-half bytes. Similarly the remaining instructions indicate.
These are the features which do not depend on the architecture of the machine. These are:
Literals
Expressions
Program blocks
Control sections
42
IT T46 SYSTEM SOFTWARE
Literals
A literal is defined with a prefix = followed by a specification of the literal value.
Example:
45 001A ENDFIL LDA =C’EOF’ 032010
-
-
93 LTORG
The example above shows a 3-byte operand whose value is a character string EOF. The
object code for the instruction is also mentioned. It shows the relative displacement value of the
location where this value is stored. In the example the value is at location (002D) and hence the
displacement value is (010). As another example the given statement below shows a 1-byte literal
with the hexadecimal value ‘05’.
It is important to understand the difference between a constant defined as a literal and a constant
defined as an immediate operand. In case of literals the assembler generates the specified value as a
constant at some other memory location in immediate mode the operand value is assembled as part of
the instruction itself. Example
All the literal operands used in a program are gathered together into one or more literal pools.
This is usually placed at the end of the program. The assembly listing of a program containing literals
usually includes a listing of this literal pool, which shows the assigned addresses and the generated data
values. In some cases it is placed at some other location in the object program. An assembler directive
LTORG is used. Whenever the LTORG is encountered, it creates a literal pool that contains all the
literal operands used since the beginning of the program. The literal pool definition is done after LTORG
is encountered. It is better to place the literals close to the instructions.
A literal table is created for the literals which are used in the program. The literal table contains
the literal name, operand value and length. The literal table is usually created as a hash table on the
literal name.
43
IT T46 SYSTEM SOFTWARE
Implementation of Literals
During Pass-1:
The literal encountered is searched in the literal table. If the literal already exists, no action is
taken; if it is not present, the literal is added to the LITTAB and for the address value it waits till it
encounters LTORG for literal definition. When Pass 1 encounters a LTORG statement or the end of the
program, the assembler makes a scan of the literal table. At this time each literal currently in the table
is assigned an address. As addresses are assigned, the location counter is updated to reflect the number
of bytes occupied by each literal.
During Pass-2:
The assembler searches the LITTAB for each literal encountered in the instruction and replaces
it with its equivalent value as if these values are generated by BYTE or WORD. If a literal represents
an address in the program, the assembler must generate a modification relocation for, if it all it gets
affected due to relocation. The following figure shows the difference between the SYMTAB and
LITTAB
Symbol-Defining Statements
EQU Statement
Most assemblers provide an assembler directive that allows the programmer to define
symbols and specify their values. The directive used for this EQU (Equate). The general form of the
statement is
44
IT T46 SYSTEM SOFTWARE
This statement defines the given symbol (i.e., entering in the SYMTAB) and assigning to it the
value specified. The value can be a constant or an expression involving constants and any other symbol
which is already defined. One common usage is to define symbolic names that can be used to improve
readability in place of numeric values. For example
+LDT #4096
This loads the register T with immediate value 4096, this does not clearly what exactly this value
indicates. If a statement is included as:
MAXLEN EQU 4096 and then
+LDT #MAXLEN
Then it clearly indicates that the value of MAXLEN is some maximum length value. When
the assembler encounters EQU statement, it enters the symbol MAXLEN along with its value in
the symbol table. During LDT the assembler searches the SYMTAB for its entry and its equivalent
value as the operand in the instruction. The object code generated is the same for both the options
discussed, but is easier to understand. If the maximum length is changed from 4096 to 1024, it is
difficult to change if it is mentioned as an immediate value wherever required in the instructions.
We have to scan the whole program and make changes wherever 4096 is used. If we mention this
value in the instruction through the symbol defined by EQU, we may not have to search the whole
program but change only the value of MAXLENGTH in the EQU statement (only once).
Another common usage of EQU statement is for defining values for the general-purpose
registers. The assembler can use the mnemonics for register usage like a-register A, X – index
register and so on. But there are some instructions which requires numbers in place of names in the
instructions. For example in the instruction RMO 0, 1 instead of RMO A, X. The programmer can
assign the numerical values to these registers using EQU directive.
A EQU 0
X EQU 1 and so on
These statements will cause the symbols A, X, L… to be entered into the symbol table
with their respective values. An instruction RMO A, X would then be allowed. As another usage
if in a machine that has many general purpose registers named as R1, R2… some may be used as
base register, some may be used as accumulator. Their usage may change from one program to
another. In this case we can define these requirement using EQU statements.
BASE EQU R1
INDEX EQU R2
COUNT EQU R3
45
IT T46 SYSTEM SOFTWARE
One restriction with the usage of EQU is whatever symbol occurs in the right hand side of the EQU
should be predefined. For example, the following statement is not valid:
BETA EQU ALPHA
ALPHA RESW 1
As the symbol ALPHA is assigned to BETA before it is defined. The value of ALPHA is not known.
ORG Statement
This directive can be used to indirectly assign values to the symbols. The directive is usually
called ORG (for origin). Its general format is:
ORG value
Where value is a constant or an expression involving constants and previously defined symbols.
When this statement is encountered during assembly of a program, the assembler resets its location
counter (LOCCTR) to the specified value. Since the values of symbols used as labels are taken from
LOCCTR, the ORG statement will affect the values of all labels defined until the next ORG is
encountered. ORG is used to control assignment storage in the object program. Sometimes altering the
values may result in incorrect assembly.
ORG can be useful in label definition. Suppose we need to define a symbol table with the
following structure:
SYMBOL 6 Bytes
VALUE 3 Bytes
FLAG 2 Bytes
The table looks like the one given below.
46
IT T46 SYSTEM SOFTWARE
The symbol field contains a 6-byte user-defined symbol; VALUE is a one-word representation
of the value assigned to the symbol; FLAG is a 2-byte field specifies symbol type and other information.
The space for the table can be reserved by the statement:
STAB RESB 1100
If we want to refer to the entries of the table using indexed addressing, place the offset value
of the desired entry from the beginning of the table in the index register. To refer to the fields
SYMBOL, VALUE, and FLAGS individually, we need to assign the values first as shown below:
SYMBOL EQU STAB
VALUE EQU STAB+6
FLAGS EQU STAB+9
To retrieve the VALUE field from the table indicated by register X, we can write a statement:
LDA VALUE, X
The same thing can also be done using ORG statement in the following way:
ORG ALPHA
BYTE1 RESB 1
BYTE2 RESB 1
BYTE3 RESB 1
ORG
ALPHA RESB 1
The sequence could not be processed as the symbol used to assign the new location counter
value is not defined. In first pass, as the assembler would not know what value to assign to ALPHA,
47
IT T46 SYSTEM SOFTWARE
the other symbol in the next lines also could not be defined in the symbol table. This is a kind of
problem of the forward reference.
Expressions
Assemblers also allow use of expressions in place of operands in the instruction. Each
such expression must be evaluated to generate a single operand value or address. Assemblers
generally arithmetic expressions formed according to the normal rules using arithmetic
operators +, - *, /. Division is usually defined to produce an integer result. Individual terms
may be constants, user-defined symbols, or special terms. The only special term used is * (the
current value of location counter) which indicates the value of the next unassigned memory
location. Thus the statement
BUFFEND EQU *
Assigns a value to BUFFEND, which is the address of the next byte following the buffer
area. Some values in the object program are relative to the beginning of the program and some
are absolute (independent of the program location, like constants). Hence, expressions are
classified as either absolute expression or relative expressions depending on the type of value
they produce.
Absolute Expressions: The expression that uses only absolute terms is absolute
expression. Absolute expression may contain relative term provided the relative terms
occur in pairs with opposite signs for each pair. Example:
In the above instruction the difference in the expression gives a value that does not
depend on the location of the program and hence gives an absolute immaterial o the relocation
of the program. The expression can have only absolute terms. Example:
MAXLEN EQU 1000
Relative Expressions: All the relative terms except one can be paired as described in
“absolute”. The remaining unpaired relative term must have a positive sign. Example:
Handling the type of expressions: to find the type of expression, we must keep track the type of
symbols used. This can be achieved by defining the type in the symbol table against each of the
symbol as shown in the table below:
48
IT T46 SYSTEM SOFTWARE
Program Blocks
Program blocks allow the generated machine instructions and data to appear in the object
program in a different order by Separating blocks for storing code, data, stack, and larger data block.
Assembler Directive USE
USE [block name]
At the beginning, statements are assumed to be part of the unnamed (default) block. If no USE
statements are included, the entire program belongs to this single block. Each program block may
actually contain several separate segments of the source program. Assemblers rearrange these segments
to gather together the pieces of each block and assign address. Separate the program into blocks in a
particular order. Large buffer area is moved to the end of the object program. Program readability is
better if data areas are placed in the source program close to the statements that reference them.
49
IT T46 SYSTEM SOFTWARE
Example Code
50
IT T46 SYSTEM SOFTWARE
Pass 1
A separate location counter for each program block is maintained.
Calculate the address for each symbol relative to the start of the object program by adding o
The location of the symbol relative to the start of its block
Control Sections
A control section is a part of the program that maintains its identity after assembly; each
control section can be loaded and relocated independently of the others. Different control sections are
51
IT T46 SYSTEM SOFTWARE
most often used for subroutines or other logical subdivisions. The programmer can assemble, load, and
manipulate each of these control sections separately.
Because of this, there should be some means for linking control sections together. For example,
instructions in one control section may refer to the data or instructions of other control sections. Since
control sections are independently loaded and relocated, the assembler is unable to process these
references in the usual way. Such references between different control sections are called external
references.
The assembler generates the information about each of the external references that will allow
the loader to perform the required linking. When a program is written using multiple control sections,
the beginning of each of the control section is indicated by an assembler directive
assembler directive: CSECT
The syntax
Sec name CSECT
Control sections differ from program blocks in that they are handled separately by the
assembler. Symbols that are defined in one control section may not be used directly another control
section; they must be identified as external reference for the loader to handle. The external references
are indicated by two assembler directives:
It is the statement in a control section, names symbols that are defined in this section but may
be used by other control sections. Control section names do not need to be named in the EXTREF as
they are automatically considered as external symbols.
It names symbols that are used in this section but are defined in some other control section.
The order in which these symbols are listed is not significant. The assembler must include proper
information about the external references in the object program that will cause the loader to insert the
proper value where they are required.
52
IT T46 SYSTEM SOFTWARE
53
IT T46 SYSTEM SOFTWARE
Can only use extended format to provide enough room (that is, relative addressing for
external reference is invalid).
The assembler generates information for each external reference that will allow the loader to
perform the required linking.
Case 2
190 0028 MAXLEN WORD BUFEND-BUFFER 000000
There are two external references in the expression, BUFEND and BUFFER.
54
IT T46 SYSTEM SOFTWARE
Case 3
On line 107, BUFEND and BUFFER are defined in the same control section and the expression can
be calculated immediately.
107 1000 MAXLEN EQU BUFEND-BUFFER
55
IT T46 SYSTEM SOFTWARE
56
IT T46 SYSTEM SOFTWARE
The assembler must also include information in the object program that will cause the loader
to insert the proper value where they are required. The assembler maintains two new record in the object
code and a changed version of modification record.
• Col. 1 D
Modification record
• Col. 1 M
Col.11-16 External symbol whose value is to be added to or subtracted from the indicated field
A define record gives information about the external symbols that are defined in this control
section, i.e., symbols named by EXTDEF.A refer record lists the symbols that are used as external
references by the control section, i.e., symbols named by EXTREF.
The new items in the modification record specify the modification to be performed: adding or
subtracting the value of some external symbol. The symbol used for modification may be defined either
in this control section or in another section.
The object program is shown below. There is a separate object program for each of the control
sections. In the Define Record and refer record the symbols named in EXTDEF and EXTREF are
included.
57
IT T46 SYSTEM SOFTWARE
In the case of Define, the record also indicates the relative address of each external symbol
within the control section. For EXTREF symbols, no address information is available. These symbols
are simply named in the Refer record.
58
IT T46 SYSTEM SOFTWARE
makes the handling of expressions complicated. It is required that in an expression that all the relative
terms be paired (for absolute expression), or that all except one be paired (for relative expressions).
When it comes in a program having multiple control sections then we have an extended
restriction that:
Both terms in each pair of an expression must be within the same control section
If two terms represent relative locations within the same control section, their
difference is an absolute value (regardless of where the control section is located.
Legal: BUFEND-BUFFER (both are in the same control section)
If the terms are located in different control sections, their difference has a value that
is unpredictable.
Illegal: RDREC-COPY (both are of different control section) it is the
difference in the load addresses of the two control sections. This value depends
on the way run-time storage is allocated; it is unlikely to be of any use.
The assembler evaluates all of the terms it can, combines these to form an initial
expression value, and generates Modification records.
The loader checks the expression for errors and finishes the evaluation.
59
IT T46 SYSTEM SOFTWARE
The other type produces the usual kind of object code for later execution.
Load-and-Go Assembler
Load-and-go assembler generates their object code in memory for immediate execution.
encountered:
60
IT T46 SYSTEM SOFTWARE
Omits the operand address if the symbol has not yet been defined
Enters this undefined symbol into SYMTAB and indicates that it is undefined
Adds the address of this operand address to a list of forward references associated with the
SYMTAB entry
When the definition for the symbol is encountered, scans the reference list and inserts the address.
At the end of the program, reports the error if there are still SYMTAB entries indicated undefined
symbols.
For Load-and-Go assembler
Search SYMTAB for the symbol named in the END statement and jumps to this
location to begin execution if there is no error
The status is that upon this point the symbol RREC is referred once at location 2013,
ENDFIL at 201F and WRREC at location 201C. None of these symbols are defined. The figure
shows that how the pending definitions along with their addresses are included in the symbol table.
The status after scanning line 160, which has encountered the definition of RDREC and ENDFIL is as
given below:
61
IT T46 SYSTEM SOFTWARE
If the operand contains an undefined symbol, use 0 as the address and write the Text
record to the object program.
Forward references are entered into lists as in the load-and-go assembler.
When the definition of a symbol is encountered, the assembler generates another Text
record with the correct operand address of each entry in the reference list.
When loaded, the incorrect address 0 will be updated by the latter Text record containing the
symbol definition.
62
IT T46 SYSTEM SOFTWARE
Forward references tend to create difficulty for a person reading the program.
The undefined symbol (marked with a flag *) associated with a list of symbols depend on
this undefined symbol.
When a symbol is defined, we can recursively evaluate the symbol expressions depending on
the newly defined symbol.
63
IT T46 SYSTEM SOFTWARE
64
IT T46 SYSTEM SOFTWARE
MASM Assembler
The Microsoft Macro Assembler is an X86 architecture assembler for MS-DOS and
Microsoft Windows. While the name MASM has earlier usage as the Unisys OS 1100 Meta-Assembler,
it is commonly understood in more recent years to refer to the Microsoft Macro Assembler. It is an
archetypal MACRO assembler for the x86 PC market that is owned and maintained by a major operating
system vendor and since the introduction of MASM version 6.0 in 1991 has had a powerful preprocessor
that supports pseudo high level emulation of variety of high level constructions including loop code,
conditional testing and has a semi-automated system of procedure creation and management available
if required. Version 6.11d was 32 bit object module capable using a specialized linker available in the
WinNT 3.5 SDK but with the introduction of binary patches that upgraded version 6.11d, all later
versions were 32 bit Portable Executable console mode application that produced both OMF and COFF
object modules for 32 bit code.
2.5 INTERPRETERS
Java virtual machine (JVM) interprets compiled Java binary code (called byte code) for a
computer's processor (or "hardware platform") so that it can perform a Java program's
instructions. Java was designed to allow application programs to be built that could be run on
any platform without having to be rewritten or recompiled by the programmer for each separate
platform. A Java virtual machine makes this possible because it is aware of the specific
instruction lengths and other particularities of the platform.
JIT compiling, not interpreting, is used in most JVMs today to achieve greater speed
Need to be implemented for each platform.
Although the details vary from machine to machine, all JVM understand the same byte code.
Java compiler produces an intermediate code known as byte code for a machine, known as JVM.
It exists only inside the computer memory.
65
IT T46 SYSTEM SOFTWARE
Machine code is generated by the java interpreter by acting as an intermediary between the virtual
machine and real machine.
Interpreter
Simple, compact
Slow
Just-in-time compilation
State-of-the-art for desktop/server
Too resource consuming in embedded systems
Batch compilation
Hardware implementation
66
IT T46 SYSTEM SOFTWARE
Method area
Class description
Code
Constant pool
Heap
Objects and Arrays
Shared by all threads
Garbage collected
Stack
Thread private
Logical stack that contains:
Invocation frame
Local variable area
Operand stack
Not necessary a single stack
Local variables and operand stack are accessed frequently.
67
IT T46 SYSTEM SOFTWARE
A method's byte code stream is a sequence of instructions for the Java virtual machine. Each
instruction consists of a one-byte op code followed by zero or more operands. The op code indicates
the action to take. If more information is required before the JVM can take the action, that information
is encoded into one or more operands that immediately follow the op code.
Each type of op code has a mnemonic. In the typical assembly language style, streams of Java
byte codes can be represented by their mnemonics followed by any operand values. For example, the
following stream of byte codes can be disassembled into mnemonics:
Disassembly:
iconst_0 // 03
istore_0 // 3b
iinc 0, 1 // 84 00 01
iload_0 // 1a
iconst_2 // 05
imul // 68
istore_0 // 3b
goto -7 // a7 ff f9
The byte code instruction set was designed to be compact. All instructions, except two that deal
with table jumping, are aligned on byte boundaries. The total number of op codes is small enough so
that op codes occupy only one byte. This helps minimize the size of class files that may be traveling
across networks before being loaded by a JVM. It also helps keep the size of the JVM implementation
small.
68
.
IT T46 SYSTEM SOFTWARE
All computation in the JVM centers on the stack. Because the JVM has no registers for storing
arbitrary values, everything must be pushed onto the stack before it can be used in a calculation. Byte
code instructions therefore operate primarily on the stack. For example, in the above byte code sequence
a local variable is multiplied by two by first pushing the local variable onto the stack with the iload_0
instruction, then pushing two onto the stack with iconst_2. After both integers have been pushed onto
the stack, the imul instruction effectively pops the two integers off the stack, multiplies them, and pushes
the result back onto the stack. The result is popped off the top of the stack and stored back to the local
variable by the istore_0 instruction. The JVM was designed as a stack-based machine rather than a
register-based machine to facilitate efficient implementation on register-poor architectures such as the
Intel 486.
Byte Code:
-A highly optimized set of instructions to be executed by the java runtime system, known as
java virtual machine (JVM).
69
.
IT T46 SYSTEM SOFTWARE
MSIL stands for Microsoft Intermediate Language. We can call it as Intermediate Language
(IL) or Common Intermediate Language (CIL). During the compile time, the compiler convert the
source code into Microsoft Intermediate Language (MSIL) .Microsoft Intermediate Language (MSIL)
is a CPU-independent set of instructions that can be efficiently converted to the native code. During the
runtime the Common Language Runtime (CLR)'s Just In Time (JIT) compiler converts the Microsoft
Intermediate Language (MSIL) code into native code to the Operating System.
During compilation of CLI programming languages, the source code is translated into CIL code
rather than into platform- or processor-specific object code. CIL is a CPU- and platform-independent
instruction set that can be executed in any environment supporting the Common Language
Infrastructure, such as the .NET runtime on Windows, or the cross-platform Mono runtime. In theory,
this eliminates the need to distribute different executable files for different platforms and CPU types.
CIL code is verified for safety during runtime, providing better security and reliability than natively
compiled executable files.
70
IT T46 SYSTEM SOFTWARE
Source code is converted to CIL i.e. Common Intermediate Language, which is the CLI's
equivalent to assembly language for a CPU.
CIL is then assembled into a form of so-called byte code and a CLI assembly is created.
Upon execution of a CLI assembly, its code is passed through the runtime's JIT compiler to generate
native code. Ahead-of-time compilation may also be used, which eliminates this step, but at the
cost of executable-file portability.
The computer's processor executes the native code.
CLR sits on top of OS to provide a virtual environment for hosting managed applications o
Is CLR similar to in Java
o Java Virtual Machine (JVM)
CLR loads modules containing executable and executes their code
Code might be managed or unmanaged
In either case the CLR determines what to do with it
Managed Code consists of instructions written in a pseudo-machine language called common
intermediate language, or IL.
IL instructions are just-in-time (JIT) compiled into native machine code at run time
71
IT T46 SYSTEM SOFTWARE
Execution
Just-in-time compilation
Just-in-time compilation (JIT) involves turning the byte-code into code immediately executable
by the CPU. The conversion is performed gradually during the program's execution. JIT compilation
provides environment-specific optimization, runtime type safety, and assembly verification. To
accomplish this, the JIT compiler examines the assembly metadata for any illegal accesses and handles
violations appropriately.
Ahead-of-time compilation
72
IT T46 SYSTEM SOFTWARE
The first instruction contains a forward reference RETADR. If we attempt to translate the
program line by line, we will unable to process the statement in line10 because we do not know the
address that will be assigned to RETADR .The address is assigned later(in line 80) in the program.
73
IT T46 SYSTEM SOFTWARE
Write the steps required to translate the source program to object program.
Convert mnemonic operation codes to their machine language equivalents.
Convert symbolic operands to their equivalent machine addresses
Build the machine instruction in the proper format.
Convert the data constants specified in the source program into their internal machine
representation
Write the object program and assembly listing.
13. What are the two different types of jump statements used in MASM assembler?
Near jump
A near jump is a jump to a target in the same segment and it is assembled by using a
current code segment CS.
Far jump
A far jump is a jump to a target in a different code segment and it is assembled by
using different segment registers.
74
IT T46 SYSTEM SOFTWARE
Write down the pass numbers (PASS 1/ PASS 2) of the following activities that occur in a two
pass assembler:
a. Object code generation
b. Literals added to literal
table c. Listing printed
d. Address location of local symbols
Answer:
a. Object code generation - PASS 2
b. Literals added to literal table – PASS 1
c. Listing printed – PASS2
d. Address location of local symbols – PASS1
75
IT T46 SYSTEM SOFTWARE
process these references in normal way. Such references between controls are called external
references.
22. What is the difference between the assembler directive EXTREF and EXTDEF.
EXTDEF names external symbols that are defined in a particular control section and may be
used by other sections.
EXTREF names external symbols that are referred in a particular control section and defined
in another control section.
76
IT T46 SYSTEM SOFTWARE
Unit-III
Loaders and Linkers: Basic loader functions, machine – dependent and machine –
independent loader features. Loader design – Linkage editors, dynamic linking and bootstrap loaders.
Introduction
The Source Program written in assembly language or high level language will be converted to
object program, which is in the machine language form for execution. This conversion either from
assembler or from compiler, contains translated instructions and data values from the source program,
or specifies addresses in primary memory where these items are to be loaded for execution. This
contains the following three processes, and they are,
Loading - which allocates memory location and brings the object program into memory for
execution - (Loader)
Linking- which combines two or more separate object programs and supplies the information
needed to allow references between them - (Linker)
Relocation - which modifies the object program so that it can be loaded at an address different
from the location originally specified - (Linking Loader)
Source Object
Translator Loader Object Program
Program Program Ready for
Execution
Memory
77
IT T46 SYSTEM SOFTWARE
Memory
Fig 3.2: The Role of Loader with Assembler
Loader
Memory
Fig 3.3: The Role of both Loader and Linker
Type of Loaders
The different types of loaders are, absolute loader, bootstrap loader, relocating loader
(relative loader), and, direct linking loader. The following sections discuss the functions and design
of all these types of loaders.
The algorithm for this type of loader is given here. The object program and, the object
program loaded into memory by the absolute loader are also shown. Each byte of assembled code
is given using its hexadecimal representation in character form. Easy to read by human beings.
78
IT T46 SYSTEM SOFTWARE
Each byte of object code is stored as a single byte. Most machine store object programs in a binary
form, and we must be sure that our file and device conventions do not cause some of the program
bytes to be interpreted as control characters.
Begin
read Header record
verify program name and length
79
IT T46 SYSTEM SOFTWARE
A GETC (and convert it from the ASCII
character code to the value of the hexadecimal
digit) save the value in the high-order 4 bits of S
A GETC
combine the value to form one byte A (A+S)
store the value (in A) to the address in register X
X X+1
End
80
IT T46 SYSTEM SOFTWARE
This needs the design and implementation of a more complex loader. The loader must provide
program relocation and linking, as well as simple loading functions.
3.2.1 RELOCATION
The concept of program relocation is, the execution of the object program using any part of the
available and sufficient memory. The object program is loaded into memory wherever there is room for
it. The actual starting address of the object program is not known until load time. Relocation provides
the efficient sharing of the machine with larger memory and when several independent programs are to
be run together. It also supports the use of subroutine libraries efficiently. Loaders that allow for
program relocation are called relocating loaders or relative loaders.
Use of modification record and, use of relocation bit, are the methods available for specifying
relocation. In the case of modification record, a modification record M is used in the object program to
specify any relocation. In the case of use of relocation bit, each instruction is associated with one
relocation bit and, these relocation bits in a Text record is gathered into bit masks.
Modification records are used in complex machines and is also called Relocation and Linkage Directory
(RLD) specification. The format of the modification record (M) is as follows. The object program with
relocation by Modification records is also shown here.
81
IT T46 SYSTEM SOFTWARE
Modification record
Col 1: M
Col 2-7: relocation address
Col 8-9: length (half byte)
Col 10: flag (+/-)
Col 11-17: segment name
The relocation bit method is used for simple machines. Relocation bit is 0: no modification is
necessary, and is 1: modification is needed. This is specified in the columns 10-12 of text record (T),
the format of text record, along with relocation bits is as follows.
Text record
Col 1 :T
Col 2-7 : starting address
Col 8-9 : length (byte)
Col 10-12 : relocation bits
Col 13-72 : object code
Twelve-bit mask is used in each Text record (col:10-12 – relocation bits), since each text record
contains less than 12 words, unused words are set to 0, and, any value that is to be modified during
relocation must coincide with one of these 3-byte segments. For absolute loader, there are no relocation
bits column 10-69 contains object code. The object program with relocation by bit mask is as shown
below. Observe FFC - means all ten words are to be modified and, E00 - means first three records are
to be modified.
82
IT T46 SYSTEM SOFTWARE
T^00001E^15^E00^0C0036^481061^080033^4C0000^…^000003^000000
T^001039^1E^FFC^040030^000030^…^30103F^D8105D^280030^...
T^001057^0A^800^100036^4C0000^F1^001000
T^001061^19^FE0^040030^E01079^…^508039^DC1079^2C0036^...
E^000000
EXTREF (external reference) - The EXTREF statement names symbols used in this (present) control
section and are defined elsewhere.
Ex: EXTREF RDREC, WRREC
EXTREF LISTB, ENDB, LISTC, ENDC
Define record
The format of the Define record (D) along with examples is as shown here.
Col. 1 D
Col. 2-7 Name of external symbol defined in this control section
Col. 8-13 Relative address within this control section (hexadecimal)
Col.14-73 Repeat information in Col. 2-13 for other external symbols
Example records
D LISTA 000040 ENDA 000054
D LISTB 000060 ENDB 000070
83
IT T46 SYSTEM SOFTWARE
Refer record
The format of the Refer record (R) along with examples is as shown here.
Col. 1 R
Col. 2-7 Name of external symbol referred to in this control section
Col. 8-73 Name of other external reference symbols
Example records
R LISTB ENDB LISTC ENDC
R LISTA ENDA LISTC ENDC
R LISTA ENDA LISTB ENDB
Here are the three programs named as PROGA, PROGB and PROGC, which are separately
assembled and each of which consists of a single control section. LISTA, ENDA in PROGA, LISTB,
ENDB in PROGB and LISTC, ENDC in PROGC are external definitions in each of the control sections.
Similarly LISTB, ENDB, LISTC, ENDC in PROGA, LISTA, ENDA, LISTC, ENDC in PROGB, and
LISTA, ENDA, LISTB, ENDB in PROGC, are external references. These sample programs given here
are used to illustrate linking and relocation. The following figures give the sample programs and their
corresponding object programs. Observe the object programs, which contain D and R records along
with other records.
0000 PROGA START 0
EXTDEF LISTA, ENDA
EXTREF LISTB, ENDB, LISTC, ENDC
………..
……….
0020 REF1 LDA LISTA 03201D
0023 REF2 +LDT LISTB+4 77100004
0027 REF3 LDX #ENDA-LISTA 050014
.
.
0040 LISTA EQU *
0054 ENDA EQU *
0054 REF4 WORD ENDA-LISTA+LISTC 000014
0057 REF5 WORD ENDC-LISTC-10 FFFFF6
005A REF6 WORD ENDC-LISTC+LISTA-1 00003F
005D REF7 WORD ENDA-LISTA-(ENDB-LISTB) 000014
0060 REF8 WORD LISTB-LISTA FFFFC0
END REF1
84
IT T46 SYSTEM SOFTWARE
85
IT T46 SYSTEM SOFTWARE
86
IT T46 SYSTEM SOFTWARE
000073 06 +ENDC
M000076 06 –LISTC
M000076 06+LISTA
M000079 06+ENDA
M000079 06 -LISTA
M00007C 06+PROGB
M 00007C 06-LISTA E
00004B 06+ENDA
M00004B 006-LISTA
M00004B 06-ENDB
M00004B 06+LISTB
M00004E 06+LISTB
M 00004E 06-LISTA E
The following figure shows these three programs as they might appear in memory after loading
and linking. PROGA has been loaded starting at address 4000, with PROGB and PROGC immediately
following.
87
IT T46 SYSTEM SOFTWARE
For example, the value for REF4 in PROGA is located at address 4054 (the beginning address
of PROGA plus 0054, the relative address of REF4 within PROGA). The following figure shows the
details of how this value is computed.
88
IT T46 SYSTEM SOFTWARE
89
IT T46 SYSTEM SOFTWARE
Linking Loader uses two-pass logic. ESTAB (external symbol table) is the main data structure
for a linking loader.
Pass 1: Assign addresses to all external symbols
Pass 2: Perform the actual loading, relocation, and linking
ESTAB - ESTAB for the example (refer three programs PROGA PROGB and PROGC). The
ESTAB has four entries in it; they are name of the control section, the symbol appearing in the control
section, its address and length of the control section.
Pass 1 assign addresses to all external symbols. The variables & Data structures used during
pass 1 are, PROGADDR (program load address) from OS, CSADDR (control section address), CSLTH
(control section length) and ESTAB. The pass 1 processes the Define Record. The algorithm for Pass
1 of Linking Loader is given below.
90
IT T46 SYSTEM SOFTWARE
Pass 2 of linking loader perform the actual loading, relocation, and linking. It uses modification
record and lookup the symbol in ESTAB to obtain its address. Finally it uses end record of a main
program to obtain transfer address, which is a starting address needed for the execution of the program.
The pass 2 process Text record and Modification record of the object programs. The algorithm for Pass
2 of Linking Loader is given below.
91
IT T46 SYSTEM SOFTWARE
92
IT T46 SYSTEM SOFTWARE
Symbol and Addresses in PROGA, PROGB and PROGC are as shown below. These are
the entries of ESTAB. The main advantage of reference number mechanism is that it avoids multiple
searches of ESTAB for the same symbol during the loading of a control section
1 PROGA 4000
2 LISTB 40C3
3 ENDB 40D3
4 LISTC 4112
5 ENDC 4124
93
IT T46 SYSTEM SOFTWARE
1 PROGB 4063
2 LISTA 4040
3 ENDA 4054
4 LISTC 4112
5 ENDC 4124
1 PROGC 4063
2 LISTA 4040
3 ENDA 4054
4 LISTB 40C3
5 ENDB 40D3
94
IT T46 SYSTEM SOFTWARE
Here is one more example giving, how commands can be specified as a part of object file, and the
respective changes are carried out by the loader.
LIBRARY UTLIB
INCLUDE READ (UTLIB)
INCLUDE WRITE (UTLIB)
DELETE RDREC, WRREC
CHANGE RDREC, READ
CHANGE WRREC, WRITE
NOCALL SQRT, PLOT
The commands are, use UTLIB (say utility library), include READ and WRITE control sections
from the library, delete the control sections RDREC and WRREC from the load, the change command
causes all external references to the symbol RDREC to be changed to the symbol READ, similarly
references to WRREC is changed to WRITE, finally, no call to the functions SQRT, PLOT, if they are
used in the program.
95
IT T46 SYSTEM SOFTWARE
The above diagram shows the processing of an object program using Linking Loader. The
source program is first assembled or compiled, producing an object program. A linking loader performs
all linking and loading operations, and loads the program into memory for execution.
96
IT T46 SYSTEM SOFTWARE
Some useful functions of Linkage editor are, an absolute object program can be created, if
starting address is already known. New versions of the library can be included without changing the
source program. Linkage editors can also be used to build packages of subroutines or other control
sections that are generally used together. Linkage editors often allow the user to specify that external
references are not to be resolved by automatic library search – linking will be done later by linking
loader – linkage editor + linking loader – savings in space
Dynamic linking is often used to allow several executing programs to share one copy of a
subroutine or library.
For example, a single copy of the standard C library can be loaded into memory.
All C programs currently in execution can be linked to this one copy, instead of linking a separate
copy into each object program.
In an object-oriented system, dynamic linking is often used for references to software object.
This allows the implementation of the object and its method to be determined at the time the
program is run. (e.g., C++)
The implementation can be changed at any time, without affecting the program that makes use of
the object.
The subroutines that diagnose errors may never need to be called at all.
However, without using dynamic linking, these subroutines must be loaded and linked every time
the program is run.
97
IT T46 SYSTEM SOFTWARE
Using dynamic linking can save both space for storing the object program on disk and in memory,
and time for loading the bigger object program.
A subroutine that is to be dynamically loaded must be called via an operating system service
request.
– This method can also be thought of as a request to a part of the loader that is kept in
memory during execution of the program
Instead of executing a JSUB instruction to an external symbol, the program makes a load-and-call
service request to the OS.
The parameter of this request is the symbolic name of the routine to be called.
The OS examines its internal tables to determine whether the subroutine is already loaded.
If needed, the subroutine is loaded from the library.
Then control is passed from the OS to the subroutine being called.
When the called subroutine completes its processing, it returns to its caller (operating system).
The OS then returns control to the program that issues the request.
After the subroutine is completed, the memory that was allocated to it may be released.
However, often this is not done immediately. If the subroutine is retained in memory, it can be used
by later calls to the same subroutine without loading the same subroutine multiple times.
Control can simply pass from the dynamic loader to the called routine directly.
Implementation Example
98
IT T46 SYSTEM SOFTWARE
99
IT T46 SYSTEM SOFTWARE
100
IT T46 SYSTEM SOFTWARE
15. Give the difference between linking loader and linkage editors.
101
IT T46 SYSTEM SOFTWARE
102
IT T46 SYSTEM SOFTWARE
UNIT-IV
Macro Processors: Functions – Machine independent macro processor features – macro
processor design option-Implementation examples.
A Macro represents a commonly used group of statements in the source programming language.
A macro instruction (macro) is a notational convenience for the programmer
It allows the programmer to write shorthand version of a program (module
programming)
The macro processor replaces each macro instruction with the corresponding group of source
language statements (expanding)
Normally, it performs no analysis of the text it handles.
It does not concern the meaning of the involved statements during macro expansion.
The design of a macro processor generally is machine independent!
Two new assembler directives are used in macro definition
MACRO: identify the beginning of a macro definition
103
IT T46 SYSTEM SOFTWARE
M1 is a macro with two parameters D1 and D2. The MACRO stores the contents of register A
in D1 and the contents of register B in D2. Later M1 is invoked with the parameters DATA1 and
DATA2, Second time with DATA4 and DATA3. Every call of MACRO is expended with the
executable statements.
The statement M1 DATA1, DATA2 is a macro invocation statements that gives the name of
the macro instruction being invoked and the arguments (M1 and M2) to be used in expanding. A macro
invocation is referred as a Macro Call or Invocation.
Macro Expansion
The program with macros is supplied to the macro processor. Each macro invocation statement
will be expanded into the statement s that form the body of the macro, with the arguments from the
macro invocation substituted for the parameters in the macro prototype. During the expansion, the
macro definition statements are deleted since they are no longer needed.
The arguments and the parameters are associated with one another according to their positions.
The first argument in the macro matches with the first parameter in the macro prototype and so on.
After macro processing the expanded file can become the input for the Assembler. The Macro
Invocation statement is considered as comments and the statement generated from expansion is treated
exactly as though they had been written directly by the programmer.
The difference between Macros and Subroutines is that the statement s from the body of the
Macro is expanded the number of times the macro invocation is encountered, whereas the statement
104
IT T46 SYSTEM SOFTWARE
of the subroutine appears only once no matter how many times the subroutine is called. Macro
instructions will be written so that the body of the macro contains no labels.
Problem of the label in the body of macro:
If the same macro is expanded multiple times at different places in the program …
There will be duplicate labels, which will be treated as errors by the assembler.
Solutions:
Do not use labels in the body of macro.
JLT *-14
It is inconvenient and error-prone.
The following program shows the concept of Macro Invocation and Macro Expansion.
105
IT T46 SYSTEM SOFTWARE
106
IT T46 SYSTEM SOFTWARE
In the example below, the body of the first Macro (MACROS) contains statement that define
RDBUFF, WRBUFF and other macro instructions for SIC machine.
The body of the second Macro (MACROX) defines the se same macros for SIC/XE machine.
A proper invocation would make the same program to perform macro invocation to run on either
SIC or SIC/XE machine.
107
IT T46 SYSTEM SOFTWARE
A program that is to be run on SIC system could invoke MACROS whereas a program to be run
on SIC/XE can invoke MACROX.
However, defining MACROS or MACROX does not define RDBUFF and WRBUFF.
These definitions are processed only when an invocation of MACROS or MACROX is expanded.
The design considered is for one-pass assembler. The data structures required are:
108
IT T46 SYSTEM SOFTWARE
The above figure shows the portion of the contents of the table during the processing of the program.
In fig 4.2(a) definition of RDBUFF is stored in DEFTAB, with an entry in NAMTAB having
the pointers to the beginning and the end of the definition. The arguments referred by the
instructions are denoted by their positional notations. For example,
TD =X’? 1’
The above instruction is to test the availability of the device whose number is given by the
parameter &INDEV. In the instruction this is replaced by its positional value? 1.
Figure 4.2(b) shows the ARTAB as it would appear during expansion of the RDBUFF
statement as given below:
CLOOP RDBUFF F1, BUFFER, LENGTH
For the invocation of the macro RDBUFF, the first parameter is F1 (input device code), second is
BUFFER (indicating the address where the characters read are stored), and the third is
LENGTH (which indicates total length of the record to be read). When the? n notation is
encountered in a line from DEFTAB, a simple indexing operation supplies the proper argument
from ARGTAB.
The algorithm of the Macro processor is given below. This has the procedure DEFINE to make the
entry of macro name in the NAMTAB, Macro Prototype in DEFTAB. EXPAND is called to
set up the argument values in ARGTAB and expand a Macro Invocation statement. Procedure
GETLINE is called to get the next line to be processed either from the DEFTAB or from the
file itself.
109
IT T46 SYSTEM SOFTWARE
When a macro definition is encountered it is entered in the DEFTAB. The normal approach is to
continue entering till MEND is encountered. If there is a program having a Macro defined
within another Macro?
While defining in the DEFTAB the very first MEND is taken as the end of the Macro definition.
This does not complete the definition as there is another outer Macro which completes the
definition of Macro as a whole. Therefore the DEFINE procedure keeps a counter variable
LEVEL.
Every time a Macro directive is encountered this counter is incremented by 1. The moment the
innermost Macro ends indicated by the directive MEND it starts decreasing the value of the counter
variable by one. The last MEND should make the counter value set to zero. So when LEVEL becomes
zero, the MEND corresponds to the original MACRO directive.
Most macro processors allow the definitions of the commonly used instructions to appear in a
standard system library, rather than in the source program. This makes the use of macros convenient;
definitions are retrieved from the library as they are needed during macro processing.
110
IT T46 SYSTEM SOFTWARE
Algorithms:
111
IT T46 SYSTEM SOFTWARE
One-pass processor can alternate between macro definition and macro expansion
Nested macro definitions are allowed but nested calls are not allowed.
Two-pass algorithm
Pass1: Recognize macro definitions
112
IT T46 SYSTEM SOFTWARE
The design of macro processor doesn’t depend on the architecture of the machine. We will be
studying some extended feature for this macro processor. These features are:
Concatenation of Macro Parameters
Generation of unique labels
Conditional Macro Expansion
Keyword Macro Parameters
The parameter to such a macro instruction could specify the series of variables to be operated on
(A, B, etc.). The macro processor would use this parameter to construct the symbols required
in the macro expansion (XA1, Xb1, etc.).
Suppose that the parameter to such a macro instruction is named &ID. The body of the macro
definition might contain a statement like
LDA X&ID1
is the starting character of the macro instruction; but the end of the parameter is not marked. So in
the case of &ID1, the macro processor could deduce the meaning that was intended.
If the macro definition contains contain &ID and &ID1 as parameters, the situation would be
unavoidably ambiguous.
Most of the macro processors deal with this problem by providing a special concatenation
→
operator. In the SIC macro language, this operator is the character . Thus the statement
LDA X&ID1 can be written as LDA
→
X&ID .
113
IT T46 SYSTEM SOFTWARE
The above figure shows a macro definition that uses the concatenation operator as previously
described. The statement SUM A and SUM BETA shows the invocation statements and the
corresponding macro expansion.
This in turn forces us to use relative addressing in the jump instructions. Instead we can use the
technique of generating unique labels for every macro invocation and expansion.
During macro expansion each $ will be replaced with $XX, where xx is a two-character
alphanumeric counter of the number of macro instructions expansion.
For example, XX = AA, AB, AC…
This allows 1296 macro expansions in a single program.
114
IT T46 SYSTEM SOFTWARE
The following program shows the macro definition with labels to the instruction.
The following figure shows the macro invocation and expansion first time.
115
IT T46 SYSTEM SOFTWARE
If the macro is invoked second time the labels may be expanded as $ABLOOP $ABEXIT.
4.2.3 Conditional Macro Expansion
There are applications of macro processors that are not related to assemblers or assembler
programming.
Conditional assembly depends on parameters provides
MACRO &COND
……..
IF (&COND NE ‘’)
Part I
ELSE
Part II
ENDIF
………
ENDM
Part I is expanded if condition part is true, otherwise part II is expanded. Compare operators: NE, EQ,
LE, and GT.
Macro-Time Variables
Macro-time variables (often called as SET Symbol) can be used to store working values during
the macro expansion. Any symbol that begins with symbol & and not a macro instruction parameter is
considered as macro-time variable. All such variables are initialized to zero.
Fig 4.4(a): The macro RDBUFF with the parameters &INDEV, &BUFADR, &RECLTH,
&EOR, &MAXLTH
116
IT T46 SYSTEM SOFTWARE
Figure 4.4(a) gives the definition of the macro RDBUFF with the parameters &INDEV,
&BUFADR, &RECLTH, &EOR, &MAXLTH. According to the above program if &EOR has any
value, then &EORCK is set to 1 by using the directive SET, otherwise it retains its default value 0.
Fig 4.4(b): Use of Macro-Time Variable with EOF being NOT NULL
Fig 4.4(c) Use of Macro-Time conditional statement with EOF being NULL
117
IT T46 SYSTEM SOFTWARE
Fig 4.4(d) Use of Time-variable with EOF NOT NULL and MAXLENGTH being NULL
The above programs show the expansion of Macro invocation statements with different values
for the time variables. In figure 4.4(b) the &EOF value is NULL. When the macro invocation is done,
IF statement is executed, if it is true EORCK is set to 1, otherwise normal execution of the other part
of the program is continued.
The macro processor must maintain a symbol table that contains the value of all macro-time
variables used. Entries in this table are modified when SET statements are processed. The table is used
to look up the current value of the macro-time variable whenever it is required.
When an IF statement is encountered during the expansion of a macro, the specified Boolean
expression is evaluated.
If the value of this expression TRUE,
The macro processor continues to process lines from the DEFTAB until it encounters the ELSE or
ENDIF statement.
If an ELSE is found, macro processor skips lines in DEFTAB until the next ENDIF.
Once it reaches ENDIF, it resumes expanding the macro in the usual way.
118
IT T46 SYSTEM SOFTWARE
The macro-time IF-ELSE-ENDIF structure provides a mechanism for either generating (once)
or skipping selected statements in the macro body. There is another construct WHILE statement which
specifies that the following line until the next ENDW statement, are to be generated repeatedly as long
as a particular condition is true. The testing of this condition, and the looping are done during the macro
is under expansion. The example shown below shows the usage of Macro-Time Looping statement.
WHILE-ENDW structure
When a WHILE statement is encountered during the expansion of a macro, the specified Boolean
expression is evaluated.
TRUE
The macro processor continues to process lines from DEFTAB until it encounters the
next ENDW statement.
When ENDW is encountered, the macro processor returns to the preceding WHILE,
re-evaluates the Boolean expression, and takes action based on the new value.
FALSE
The macro processor skips ahead in DEFTAB until it finds the next ENDW statement
119
IT T46 SYSTEM SOFTWARE
All the macro instruction definitions used positional parameters. Parameters and arguments are
matched according to their positions in the macro prototype and the macro invocation
statement.
The programmer needs to be careful while specifying the arguments. If an argument is to be omitted
the macro invocation statement must contain a null argument mentioned with two commas.
Positional parameters are suitable for the macro invocation. But if the macro invocation has large
number of parameters, and if only few of the values need to be used in a typical invocation, a
different type of parameter specification is required
Ex:XXX MACRO &P1, &P2… &P20, …. XXX
A1, A2… A20…
Null arguments
Keyword parameters
Each argument value is written with a keyword that names the corresponding parameter.
Arguments may appear in any order.
Null arguments no longer need to be used.
Ex: XXX P1=A1, P2=A2, P20=A20.
It is easier to read and much less error-prone than the positional method.
120
IT T46 SYSTEM SOFTWARE
121
IT T46 SYSTEM SOFTWARE
The Boolean variable EXPANDING would be set to FALSE when the “inner” macro
expansion is finished, i.e., the macro process would forget that it had been in the middle
of expanding an “outer” macro.
Solutions
Write the macro processor in a programming language that allows recursive calls,
thus local variables will be retained.
If you are writing in a language without recursion support, use a stack to take care of
pushing and popping local variables and return addresses.
122
IT T46 SYSTEM SOFTWARE
The procedure EXPAND would be called when the macro was recognized. The arguments from the
macro invocation would be entered into ARGTAB as follows:
Parameter Value
1 BUFFER
2 LENGTH
3 F1
4 (unused)
- -
The Boolean variable EXPANDING would be set to TRUE, and expansion of the macro invocation
statement would begin. The processing would proceed normally until statement invoking RDCHAR is
processed. This time, ARGTAB would look like
Parameter Value
1 F1
2 (Unused)
-- --
At the expansion, when the end of RDCHAR is recognized, EXPANDING would be set to
FALSE. Thus the macro processor would ‘forget’ that it had been in the middle of expanding a macro
when it encountered the RDCHAR statement. In addition, the arguments from the original macro
invocation (RDBUFF) would be lost because the value in ARGTAB was overwritten with the arguments
from the invocation of RDCHAR.
Macro processors that do not dependent on any particular programming language, but can be used
with a variety of different languages
Pros
Programmers do not need to learn many macro languages.
Although its development costs are somewhat greater than those for a language specific
macro processor, this expense does not need to be repeated for each language, thus save
substantial overall cost.
Cons
Large number of details must be dealt with in a real programming language
Situations in which normal macro parameter substitution should not occur, e.g.,
comments.
Facilities for grouping together terms, expressions, or statements
Tokens, e.g., identifiers, constants, operators, keywords
123
IT T46 SYSTEM SOFTWARE
124
IT T46 SYSTEM SOFTWARE
A body is simply copied or substituted at the point of call Expansion with substitution of
parameters
Arguments are textually substituted for the parameters
The resulting procedure body is textually substituted for the call
Body
125
IT T46 SYSTEM SOFTWARE
MEND
Parameters: the entries in the operand field identify the parameters of the macro instruction.
We require each parameter begins with ‘&’
Body: the statements that will be generated as the expansion of the macro.
Prototype for the macro:
The macro name and parameters define a pattern or prototype for the macro instructions
used by the programmer
126
IT T46 SYSTEM SOFTWARE
Each macro invocation statement will be expanded into the statements that form the body of
the macro.
Arguments from the macro invocation are substituted for the parameters in the macro
prototype.
The arguments and parameters are associated with one another according to their positions.
The first argument in the macro invocation corresponds to the first parameter in the
macro prototype, etc.
127
IT T46 SYSTEM SOFTWARE
Program From Fig. 4.1 with Macros Expanded (fig. 4.2) (Cont.)
128
IT T46 SYSTEM SOFTWARE
129
IT T46 SYSTEM SOFTWARE
After macro processing, the expanded file can be used as input to the assembler.
The statements generated from the macro expansions will be assembled exactly as though
they had been written directly by the programmer.
The differences between macro invocation and subroutine call
The statements that form the body of the macro are generated each time a macro is
expanded.
Statements in a subroutine appear only once, regardless of how many times the
subroutine is called.
130
IT T46 SYSTEM SOFTWARE
UNIT-V
Text editors - Overview of the Editing Process - User Interface – Editor Structure. - Interactive
debugging systems - Debugging functions and capabilities – Relationship with other parts of the system
– User-Interface Criteria.
A text editor allows you to edit a text file (create, modify etc…). For example the Interactive text
editors on Windows OS - Notepad, WordPad, Microsoft Word, and text editors on UNIX OS -
vi, emacs , jed, pico.
Normally, the common editing features associated with text editors are, Moving the cursor,
Deleting, Replacing, Pasting, Searching, Searching and replacing, Saving and loading, and,
Miscellaneous(e.g. quitting).
131
IT T46 SYSTEM SOFTWARE
There are two types of editors. Manuscript-oriented editor and program oriented editors.
Manuscript-oriented editor is associated with characters, words, lines, sentences and paragraphs.
Program-oriented editors are associated with identifiers, keywords, statements. User wish – what he
wants – formatted.
button devices
Locator devices.
Text Devices are keyboard. Button Devices are special function keys, symbols on the screen.
Locator Devices are mouse, data tablet. There are voice input devices which translates spoken
words to their textual equivalents.
Output Devices are Teletypewriters (first output devices), Glass teletypes (Cathode ray tube
(CRT) technology), Advanced CRT terminals, TFT Monitors and Printers (Hard-copy).
132
IT T46 SYSTEM SOFTWARE
The interaction language could be, typing oriented or text command oriented and menu-oriented
user interface. Typing oriented or text command oriented interaction was with oldest editors, in
the form of use of commands, use of function keys, control keys etc.
Menu-oriented user interface has menu with a multiple choice set of text strings or icons. Display
area for text is limited. Menus can be turned on or off.
Editing operations are specified explicitly by the user and display operations are specified implicitly
by the editor. Traveling and viewing operations may be invoked either explicitly by the user or
implicitly by the editing operations.
In editing a document, the start of the area to be edited is determined by the current editing pointer
maintained by the editing component. Editing component is a collection of modules
133
IT T46 SYSTEM SOFTWARE
dealing with editing tasks. Current editing pointer can be set or reset due to next paragraph,
next screen, cut paragraph, paste paragraph etc..,.
When editing command is issued, editing component invokes the editing filter – generates a new
editing buffer – contains part of the document to be edited from current editing pointer. Filtering
and editing may be interleaved, with no explicit editor buffer being created.
In viewing a document, the start of the area to be viewed is determined by the current viewing
pointer maintained by the viewing component. Viewing component is a collection of modules
responsible for determining the next view. Current viewing pointer can be set or reset as a result
of previous editing operation.
When display needs to be updated, viewing component invokes the viewing filter – generates a new
viewing buffer – contains part of the document to be viewed from current viewing pointer. In
case of line editors – viewing buffer may contain the current line, Screen editors - viewing
buffer contains a rectangular cutout of the quarter plane of the text.
Viewing buffer is then passed to the display component of the editor, which produces a display by
mapping the buffer to a rectangular subset of the screen – called a window. Identical – user
edits the text directly on the screen. Disjoint – Find and Replace (For example, there are 150
lines of text, user is in 100th line, decides to change all occurrences of
‘text editor’ with ‘editor’).
The editing and viewing buffers can also be partially overlapped, or one may be completely
contained in the other. Windows typically cover entire screen or a rectangular portion of it. May
show different portions of the same file or portions of different file. Inter-file editing operations
are possible.
The components of the editor deal with a user document on two levels: In main memory and in the
disk file system. Loading an entire document into main memory may be infeasible – only part
is loaded – demand paging is used – uses editor paging routines.
Documents may not be stored sequentially as a string of characters. Uses separate editor data
structure that allows addition, deletion, and modification with a minimum of I/O and character
movement.
Stand-alone
Distributed.
134
IT T46 SYSTEM SOFTWARE
In stand-alone environment, editors on stand-alone system are built with all the functions to carry
out editing and viewing operations – The help of the OS may also be taken to carry out some
tasks like demand paging.
In distributed environment, editor has both functions of stand-alone editor; to run independently on
each user’s machine and like a time sharing editor, contend for shared resources such as files.
Tracing can be used to track the flow of execution logic and data modifications. The control flow
can be traced at different levels of detail – procedure, branch, individual instruction, and so
on…
135
IT T46 SYSTEM SOFTWARE
Trace back can show the path by which the current statement in the program was reached. It can
also show which statements have modified a given variable or parameter. The statements are
displayed rather than as hexadecimal displacements
Program-Display capabilities
A debugger should have good program-display capabilities.
Program being debugged should be displayed completely with statement numbers.
Keeping track of any changes made to the programs during the debugging session. Support for
symbolically displaying or modifying the contents of any of the variables and constants in the
program. Resume execution – after these changes.
To provide these functions, a debugger should consider the language in which the program
being debugged is written. A single debugger – many programming languages – language independent.
The debugger- a specific programming language– language dependent. The debugger must be sensitive
to the specific language being debugged.
The context being used has many different effects on the debugging interaction. The statements
are different depending on the language
136
IT T46 SYSTEM SOFTWARE
When an error is discovered, immediate debugging must be possible. The debugger must
communicate and cooperate with other operating system components such as interactive
subsystems.
Debugging is more important at production time than it is at application-development time. When
an application fails during a production run, work dependent on that application stops.
The debugger must also exist in a way that is consistent with the security and integrity
components of the system.
The debugger must coordinate its activities with those of existing and future language compilers
and interpreters.
The simple organization contribute greatly to ease of training and ease of use.
The user interaction should make use of full-screen displays and windowing-systems as much as
possible.
With menus and full-screen editors, the user has far less information to enter and remember. There
should be complete functional equivalence between commands and menus – user where unable
to use full-screen IDSs may use commands.
The command language should have a clear, logical and simple syntax.
Command formats should be as flexible as possible.
Any good IDSs should have an on-line HELP facility. HELP should be accessible from any state
of the debugging session.
137
IT T46 SYSTEM SOFTWARE
They are the primary interface to the computer for all types of “Knowledge workers” as they
compose, organize, study and manipulate computer-based information.
An interactive editor is a computer program that allows a user to create and revise a target
document.
The term document includes objects such as computer programs, texts, equations, tables,
diagrams, line arts and photographs-anything that one might find on a printed page.
Text editor is one in which the primary elements being edited are character strings of the
target text.
The document editing process is an interactive user-computer dialogue designed to
accomplish four takes:
Select the part of the target document to be viewed and manipulated
Determine how to format this view on-line and how to display it.
Specify and execute operations that modify the target document.
Update the view appropriately.
Define Traveling.
Traveling – Selection of the part of the document to be viewed and edited. It involves first
traveling through the document to locate the area of interest such as “next screenful”,”bottom”, and
“find pattern”
Traveling specifies where the area of interest is;
Filtering: The selection of what is to be viewed and manipulated is controlled by filtering.
Filtering extracts the relevant subset of the target document at the point of interest, such as next
screenful of text or next statement.
Formatting: Formatting then determines how the result of filtering will be seen as a visible
representation (the view) on a display screen or other device.
Editing: In the actual editing phase, the target document is created or altered with a set of
operations such as insert, delete, replace, move or copy.
138
IT T46 SYSTEM SOFTWARE
Input Devices: The input devices are used to enter elements of text being edited, to enter commands,
and to designate editable elements.
INPUT DEVICES are categorized as:
Text or string devices are typically typewriter like keyboards on which user presses and
release keys, sending unique code for each key. Virtually all computer key boards are of the QWERTY
type.
Button or Choice devices generate an interrupt or set a system flag, usually causing an
invocation of an associated application program. Also special function keys are also available on the
key board.
The Data Tablet is a flat, rectangular, electromagnetically sensitive panel. Either the ballpoint
pen like stylus or a puck, a small device similar to a mouse are moved over the surface. The tablet
returns to a system program the co-ordinates of the position on the data tablet at which the stylus or
puck is currently located. The program can then map these data-tablet coordinates to screen coordinates
and move the cursor to the corresponding screen position.
.Text devices with arrow (Cursor) keys can be used to simulate locator devices. Each of these
keys shows an arrow that points up, down, left, or right. Pressing an arrow key typically generates an
appropriate character sequence, the program interprets this sequence and moves the cursor in the
direction of the arrow on the key pressed.
Voice-input Devices: which translate spoken words to their textual equivalents, may prove to be
the text input devices of the future
7. Define Output Devices
The output devices let the user view the elements being edited and the result of the editing
operations. The first output devices were teletypewriters and other character-printing terminals that
generated output on paper. Next CRT (Cathode Ray Tube) technology which uses CRT screen
essentially to simulate the hard-copy teletypewriter. Todays advanced CRT terminals use hardware
assistance for such features as moving the cursor, inserting and deleting characters and lines, and
scrolling lines and pages.
8. What is Interaction Language?
Interaction Language: The interaction language of the text editor is generally one of several
common types.
The typing oriented or text command-oriented method is the oldest of the major editing
interfaces. The user communicate with the editor by typing text strings both for command names and
for operands. These strings are sent to the editor and are usually echoed to the output device.
Typed specification often requires the user to remember the exact form of all commands, or at
least their abbreviations.
Help facility have to be used or manuals have to be referred. Time consuming for in-
experienced users.
139
IT T46 SYSTEM SOFTWARE
A menu is a multiple choice set of text strings or icons which are graphical symbols that
represent objects or operations
The user can perform actions by selecting items for the menus
The editor prompts the user with a menu
One problem with menu oriented system can arise when there are many possible actions and
several choices are required to complete an action.
Editing Editing
component buffer Editing
filter
Traveling Main
component memory
input Command
language Viewing
processor Viewing Viewing filter
component buffer
Paging
Routines
Output
devices Display File
component system
Control
Data
Typical Editor Structure
10. What is the Command Language Processor?
The command Language Processor accepts input from the user’s input devices, and analyzes
the tokens and syntactic structure of the commands. It functions much like the lexical and syntactic
phases of a compiler. The command language processor may invoke the semantic routines directly. In
a text editor, these semantic routines perform functions such as editing and viewing.
140
IT T46 SYSTEM SOFTWARE
One important requirement of any IDS is the observation and control of the flow of
program execution
Setting break points – execution is suspended, use debugging commands to analyze the
progress of the program, résumé execution of the program
Setting some conditional expressions, evaluated during the debugging session, program
execution is suspended, when conditions are met, analysis is made, later execution is
resumed
A Debugging system should also provide functions such as tracing and trace back.
141