Token

                                              Token

                        Tokens are generally any unit that is not whitespace or a comment.

 /*this is program*/

void main() 

{ int a,b,c;

printf("enter values:");

scanf("%d%d",a,b);

c=a+b;

printf("%d",c);

getch();

}

/*these are token*/

void

 main() 

{

 int 

a,

b,

c;

printf

("enter values:");

scanf

("%d%d",a,b);

c

=

a

+

b;

printf("%d",c);

getch();

}

Types of tokens

1. Identifiers
2. Variable
3. Data Type
4. Keyword
5.  String
6. Operator