Supervision webpage

Supervision work for Information Theory and Coding.

There is supposed to be four supervisions for Information Theory and Coding. The supervision work will be added as the term progresses.

The supervision work will be a mix of excercises from the notes and past paper questions:

• First supervision:
  • What questions would you ask to solve problem presented on page 13 (ask least number of questions requierd),
  • Apply your solution to a random letter taken from the first page of the lecture notes.
    Total number of letters and letter frequency given below (somebody pointed out that 'z' is missing from the table, this is because I used wrong inequality in my program, assume 'z's don't exist :)):
    Total: 2314
    

    A	2	8.64304235090752E-4
    B	0	0.0
    C	7	0.003025064822817632
    D	4	0.001728608470181504
    E	6	0.0025929127052722557
    F	12	0.005185825410544511
    G	3	0.0012964563526361278
    H	2	8.64304235090752E-4
    I	1	4.32152117545376E-4
    J	1	4.32152117545376E-4
    K	0	0.0
    L	2	8.64304235090752E-4
    M	4	0.001728608470181504
    N	2	8.64304235090752E-4
    O	0	0.0
    P	4	0.001728608470181504
    Q	0	0.0
    R	3	0.0012964563526361278
    S	6	0.0025929127052722557
    T	8	0.003457216940363008
    U	1	4.32152117545376E-4
    V	0	0.0
    W	1	4.32152117545376E-4
    X	0	0.0
    Y	0	0.0
    Z	0	0.0
    a	172	0.07433016421780467
    b	25	0.010803802938634399
    c	102	0.04407951598962835
    d	75	0.032411408815903195
    e	247	0.10674157303370786
    f	52	0.02247191011235955
    g	27	0.011668107173725151
    h	62	0.02679343128781331
    i	201	0.08686257562662057
    j	2	8.64304235090752E-4
    k	0	0.0
    l	80	0.03457216940363008
    m	75	0.032411408815903195
    n	215	0.09291270527225583
    o	211	0.09118409680207433
    p	57	0.024632670700086432
    q	2	8.64304235090752E-4
    r	168	0.07260155574762317
    s	153	0.06611927398444252
    t	171	0.07389801210025929
    u	72	0.03111495246326707
    v	12	0.005185825410544511
    w	14	0.006050129645635264
    x	13	0.0056179775280898875
    y	37	0.01598962834917891

  • CST 1996 Paper 8 Question 11 (Entropy, mutual information etc.)
  • CST 1994 Paper 9 Question 5 (Memoryless binary channel)
  • CST 2003 Paper 8 Question 10 (Code construction)
• Second supervision:
  There are more questions for the second supervision, but some of them are very short. Don't be discouraged.
  • Prove the expression for Fourier Transform of Dirac delta-function given on page 54 of the notes (or end of 1.10 if the page numbers different)
  • What is the continutaion of the convolution kernel given on page 65 of the notes (or end of 3.4.1)
  • CST 1998 Paper 8 Question 11, last part (Fourier Transform)
  • CST 1995 Paper 9 Question 2 (FFT, DFT)
  • CST 2005 Paper 7 Question 8, b), c) (FT again)
  • CST 2002 Paper 7 Question 12 (Mix of different topics)
• Third supervision:
  We will continue with the remaining questions from second supervision. But try to do as many question from this batch as possible.
  • CST 2002 Paper 9 Question 10
  • CST 2001 Paper 9 Question 10
  • CST 2005 Paper 8 Question 10
  • Why is there not a single question about Gabor wavelets in the past papers?
• Fourth supervision:

Last updated 16 October 2005. Mail me at the Lab.