MINISTERO DELL'ISTRUZIONE, DELL'UNIVERSITÀ E DELLA RICERCA
DIPARTIMENTO PER L'UNIVERSITÀ, L'ALTA FORMAZIONE ARTISTICA, MUSICALE E COREUTICA E PER LA RICERCA SCIENTIFICA E TECNOLOGICA
PROGRAMMI DI RICERCA SCIENTIFICA DI RILEVANTE INTERESSE NAZIONALE
RICHIESTA DI COFINANZIAMENTO (DM n. 30 del 12 febbraio 2004)

PROGETTO DI UNA UNITÀ DI RICERCA - MODELLO B
Anno 2004 - prot. 2004015437_002
PARTE I

1.1 Tipologia del programma di ricerca
Interuniversitario 


Aree scientifico disciplinari
Area 01: Scienze matematiche e informatiche (100%) 
 
 


1.2 Durata del Programma di Ricerca

 

24 Mesi  


1.3 Coordinatore Scientifico del Programma di Ricerca

BINI  DARIO ANDREA  bini@dm.unipi.it 
MAT/08 - Analisi numerica 
Università di PISA 
Facoltà di SCIENZE MATEMATICHE FISICHE e NATURALI  
Dipartimento di MATEMATICA "Leonida Tonelli" 


1.4 Responsabile Scientifico dell'Unità di Ricerca

DI BENEDETTO  FABIO 
Professore Associato  17/05/1963  DBNFBA63E17E463A 
MAT/08 - Analisi numerica 
Università degli Studi di GENOVA 
Facoltà di SCIENZE MATEMATICHE FISICHE e NATURALI  
Dipartimento di MATEMATICA  
010-3536883
(Prefisso e telefono)
 
010-3536752
(Numero fax)
 
dibenede@dima.unige.it
(Email)
 


1.5 Curriculum scientifico del Responsabile Scientifico dell'Unità di Ricerca
Fabio Di Benedetto, born in 1963, received the "laurea" in Mathematics in 1987 at the University of Pisa with 110/110 marks "cum laude". After some fellowships from CNR (the National Research Council), in 1990 he became Researcher in Numerical Analysis at the Department of Mathematics of the University of Genova; from 2000 he is Associate Professor of Numerical Analysis at the same Department.
His teaching activity includes from 1994 classes of Numerical Calculus for undergraduate and graduate students in Computer science, Material sciences, Mechanical Engineering and Mathematics; he has been advisor of a PHD thesis and of several graduate theses in Mathematics.
His main research interests involve numerical linear algebra, with special emphasis in structured matrices (namely Toeplitz matrices) and their applications to image processing. He is author and coauthor of about 30 papers; his refereeing activity concerns Mathematical Reviews and international journals like SIAM Journal on Numerical Analysis, SIAM Journal on Matrix Analysis and Applications, SIAM Journal on Scientific Computing, BIT and Calcolo.
He cooperated to the organization of two INDAM international workshops made in Cortona on structured matrices, in 1996 (with the publication of related proceedings) and 2000, and is member of the Scientific Committee for 2004 edition.
He is the local coordinator of a project funded in 2002 by Italian Government.


1.6 Pubblicazioni scientifiche più significative del Responsabile Scientifico dell'Unità di Ricerca

 

1. DI BENEDETTO F.; SERRA CAPIZZANO S. (2002). A note on the superoptimal matrix algebra operators LINEAR AND MULTILINEAR ALGEBRA. (vol. 50 pp. 343-372)  
2. DI BENEDETTO F. (2000). Matrix structures for image applications: some examples and open problems NOTES ON NUMERICAL FLUID MECHANICS. (vol. 73 pp. 243-249)  
3. DI BENEDETTO F.; SERRA CAPIZZANO S. (1999). A unifying approach to abstract matrix algebra preconditioning NUMERISCHE MATHEMATIK. (vol. 82 pp. 57-90)  
4. BERTERO M.; BOCCACCI P.; DI BENEDETTO F.; ROBBERTO M. (1999). Restoration of chopped and nodded images in infrared astronomy INVERSE PROBLEMS. (vol. 15 pp. 345-372)  
5. DI BENEDETTO F. (1995). Analysis of preconditioning techniques for ill-conditioned Toeplitz matrices SIAM JOURNAL ON SCIENTIFIC COMPUTING. (vol. 16 pp. 682-697)  


1.7 Risorse umane impegnabili nel Programma dell'Unità di Ricerca




1.7.1 Personale universitario dell'Università sede dell'Unità di Ricerca

Personale docente

Cognome  Nome  Dipartimento   Qualifica  Settore Disc.  Mesi Uomo 
1° anno  2° anno 
1. DI BENEDETTO  Fabio  Dip. MATEMATICA  Prof. Associato  MAT/08  8  6 
2. BOCCACCI  Patrizia  Dip. INFORMATICA E SCIENZE DELL'INFORMAZIONE  Ricercatore Universitario  INF/01  3  3 
3. BRIANZI  Paola  Dip. MATEMATICA  Prof. Associato  MAT/08  4  4 
  TOTALE              15  13 


Altro personale


Nessuno

1.7.2 Personale universitario di altre Università

Personale docente

Cognome  Nome  Università  Dipartimento  Qualifica  Settore Disc.  Mesi Uomo 
1° anno  2° anno 
1. SERRA CAPIZZANO  Stefano  INSUBRIA  Dip. SCIENZE CHIMICHE, FISICHE E MATEMATICHE  PA  MAT/08  4  6 
2. TABLINO POSSIO  Cristina  MILANO-BICOCCA  Dip. MATEMATICA E APPLICAZIONI  RU  MAT/08  6  6 
3. FASINO  Dario  UDINE  Dip. MATEMATICA E INFORMATICA  PA  MAT/08  4  5 
4. BERTACCINI  Daniele  ROMA  Dip. MATEMATICA  RU  MAT/08  7  6 
  TOTALE                 21  23 


Altro personale

Cognome  Nome  Università  Dipartimento   Qualifica  Mesi Uomo 
1° anno  2° anno 
1. Donatelli  Marco  Università degli Studi INSUBRIA Varese-Como  Dip. di Fisica e Matematica  dottorando  7  7 
  TOTALE             


1.7.3 Titolari di assegni di ricerca

Cognome  Nome  Dipartimento  Data di inizio del contratto  Durata
(in anni) 
Mesi Uomo 
1° anno  2° anno 
1. ESTATICO   Claudio   Dip. MATEMATICA  02/09/2003   1  9  7 
TOTALE               


1.7.4 Titolari di borse


Nessuno

1.7.5 Personale a contratto da destinare a questo specifico programma

Qualifica  Costo previsto  Mesi Uomo  Note 
1° anno  2° anno 
1. Assegnista  18.000  9  7  possibile cofinanziamento da parte dell'Area 
  TOTALE  18.000    


1.7.6 Personale extrauniversitario indipendente o dipendente da altri Enti


Nessuno




PARTE II

2.1 Titolo specifico del programma svolto dall'Unità di Ricerca
Structured matrix analysis and applications to approximation, inverse problems and PDEs.


2.2 Settori scientifico-disciplinari interessati dal Programma di Ricerca

 

MAT/08 - Analisi numerica 
INF/01 - Informatica 


2.3 Parole chiave
TOEPLITZ MATRICES ; PRECONDITIONING FOR STRUCTURED MATRICES ; MULTIGRID FOR STRUCTURED MATRICES ; SEMISEPARABLE MATRICES ; STRUCTURED MATRICES ; LBT IMAGING


2.4 Base di partenza scientifica nazionale o internazionale
The group consists of the same people participating to a project which has been funded for the period 2002-2003 (see the web page http://bezout.dm.unipi.it). The components (eight mathematicians and one computer scientist) have a long-standing research experience in the fields of the spectral and computational analysis of wide classes of structured matrices [21,22,23,24,29,30,39,44,52] and of the regularization of inverse problems arising in several applications [7,16]. More recently, new expertises have been acquired about the feedback between structured linear algebra and applied areas including partial differential equations (PDEs), image processing and functional approximation [4,6,8,9,49,50].
The description of the scientific background will follow, in a large part, that of the previous project, obviously with the appropriate updates and additions, achieved during the project itself.

In the last years the insight about structured Toeplitz-like matrices has received a strong impulse by several research groups in numerical linear algebra.
Two main research lines have taken place in the literature. The first is more theoretical and is concerned with the spectral properties of structured sequences. The second has a more applicative appealing and is related to the design of efficient structured solvers.

Regarding the spectral properties, we recall the distributional results pioneered by Szego (see [15]) and culminated in the work of Tyrtyshnikov [56] concerning the "global behaviour" of the spectra of Toeplitz sequences. Extensions to matrix valued generating functions and to sequences arising in the preconditioning theory [42,43] as well as some applications to approximation and quadrature [45], can be found in literature. A second important extension concerns the case of structures which are of Toeplitz type "only locally" [55] or that possess different "local structures" and include, as special instance, discretizations of differential operators with boundary conditions [50,51].
A further research line of theoretical and applicative interest is the analysis of the extremal spectral behaviour for its impact in the study of the asymptotical conditioning (see [15,41,43,52] and references therein).

Concerning the numerical methods, crucial results have been recently achieved in the construction of more and more efficient algorithms for solving linear systems and least squares problems.
The first specialized techniques are the "fast" and "superfast" methods. They belong to the class of direct methods and reduce the arithmetic cost to O(n2) and O(n log2n) operations where n is the size of the systems. For an exhaustive survey on these methods often based on the notion of "displacement rank" see [35] (and the several references in the bibliography) and the book [13].
For the well conditioned case, a further improvement is represented by the use of the Preconditioned Conjugate Gradient method (PCG). A typical choice takes the preconditioner in the algebra including all the matrices that are diagonalized by a prescribed fast transform: the most widely used is the circulant class associated with the discrete Fourier transform (as Strang [54] proposed first in 1986), even though trigonometric transforms recently received particular attention [10,34].
The conclusion is that the strong clustering holds for continuous symbols and in the unilevel case while in the multilevel case the strong clustering rarely occurs and the clustering features deteriorate as the number of levels increases. The general situation is even worse since the papers [53,46] inform us that this kind of clustering is the best possible when we use matrix algebra preconditioners.
Concerning the ill-conditioned case, the analysis is more complicated and indeed many of the fast and superfast solvers show numerical instability and many of the proposed preconditioners are no longer optimal since the required number of iterations can grow with the dimension n. In this respect R.Chan and Di Benedetto, Fiorentino and Serra Capizzano introduce a new preconditioning strategy based on banded Toeplitz matrices (see [18]) that leads to optimal and superlinear [40] iterative solvers of cost O(n log(n)) for positive definite linear systems having polynomial ill conditioning, or just optimal methods for the indefinite case [39].
These ideas have been further exploited by Di Benedetto, Serra Capizzano, R.Chan, Potts and Steidl in a matrix algebra setting (see e.g. [21,44,19]). Now the problem is reduced to the band case for which we have optimal iterative solvers (the multigrid method [31] subsequently studied by R.Chan and Huckle) and direct solvers [12] of linear cost.
It is worthwhile stressing that this preconditioning strategy can be extended in a natural way [38] to the multilevel setting. Therefore the crucial problem is reduced to finding good solvers in the banded multilevel Toeplitz case. The method in [12] is no longer optimal (even if it shows a "quasi linear" arithmetic cost), while the multigrid technique is still optimal [2]. In conclusion one of the important issues to be taken into account in future works is the analysis and the design of optimal multigrid strategies for multilevel banded structures (with polynomial ill conditioning).

Two further kinds of structures, developed in the most recent literature, are worth to mention.
The first one involves shifted linear systems as (A+cI)x=b, arising in several frameworks (image processing, time-dependent PDEs, iterative eigensolvers, etc.), where the identity matrix I is sometimes replaced by a more general diagonal shift. In the previous project a new preconditioning technique has been proposed for the case where A is SPD and e is a nonnegative parameter, based on a modification of factorized approximate inverses [3].
The second one is concerned with diagonal plus semi-separable matrices, which play a crucial role in the approximation context: more precisely, the well-known link between tridiagonal matrices and orthogonal polynomials has a counterpart between this new matrix class and orthogonal rational functions [29]. Several people have considered in the last two years some computational problems related to this class, such as QR iteration for computing the eigenvalues, with promising applications to polynomial rootfinding [11,30].

From the application point of view, many concrete situations demand the fast solution of mathematical problems of very large size, characterized by the (sometimes hidden) presence of matrix structures; among the most important, we point out inverse problems arising in image processing, PDEs and functional approximation.

A very recent example of imaging device that requires the solution of challenging reconstruction problems is the Large Binocular Telescope (LBT) [1]. The underlying mathematical problem involves the reconstruction of multiple images of about 108 pixels, and therefore it needs efficient numerical methods. Other related imaging problems involve "chopping and nodding" [8] techniques for the recovering of infrared images, and adaptive optics [20].
All the numerical methods used in image reconstruction must take into account that some regularization approach is needed. Successful applications of matrix algebra preconditioning have involved the definition of a parameter-dependent family of specific preconditioners, constructed by means of a proper filtering of optimal [32] or superoptimal [26] approximations, having themselves a regularization effect.
The reconstruction obtained by a basic method can be further improved with the help of two advanced tools: boundary conditions (see [8,33,37] for classical proposals and [48] for the new anti-reflective idea) and wavelets [17].
The use of structured matrix tools is becoming standard for linear inverse problems, but is still uncommon in the nonlinear case. It is worth to mention a recent successful experience [27] along this direction, concerning a Remote Sensing problem. The mathematical model is a nonlinear ill-posed integral-differential equation, which can be treated by an outer-inner two-steps Inexact Newton iterative method. Any Newton linearized step has been regularized by means of the Landweber iterative method, leading to the use of structured matrix computational techniques.

Banded Toeplitz matrices are the main ingredient in a superlinear preconditioning strategy [49,50,51] for Finite Differences (FD), Finite Elements or Collocation discretizations of elliptic boundary value problems with nonconstant coefficients. This technique insures a strong clustering and a spectral equivalence at least when the coefficients are two times continuously differentiable, hence it gives a substantial improvement with respect to other preconditioning techniques (incomplete factorizations, approximate inverses, matrix algebras).
Finite difference discretization of time-dependent PDEs generates large nonsymmetric matrices having a block structure. Several preconditioners have been introduced, either of circulant type [4,6] or based on a Hermitian-skew Hermitian splitting [5]; both achieve a rate independent of the discretization parameter under suitable assumptions.

Finally, several problems related to polynomial and rational approximation can be described in terms of structured matrices, including Cauchy, Pick, Vandermonde, locally Toeplitz and semiseparable. The spectral properties of these matrices allow us to better understand the behaviour of numerical solvers for the underlying approximation problem.


2.4.a Riferimenti bibliografici

[1] J.Angel, J.Hill, P.Strittmatter, P.Salinari, G.Weigelt, Interferometry with the Large Binocular Telescope. Proc. SPIE 3352(1998), 881-889
[2] A.Aricò, M.Donatelli, S.Serra Capizzano, Multigrid optimal convergence for certain (multilevel) structured linear systems. SIAM J. Matr. Anal. Appl., in press
[3] M.Benzi, D.Bertaccini, Approximate inverse preconditioning for shifted linear systems. BIT 43(2003), 231-244
[4] D.Bertaccini, A circulant preconditioner for the systems of LMF-based ODE codes. SIAM J. Sci. Comp. 22(2000), 767-786
[5] D.Bertaccini, G.Golub, S.Serra Capizzano, C.Tablino Possio, Preconditioned HSS methods for the solution of non-Hermitian positive definite linear systems. Tech. Rep., Stanford Univ., 2002
[6] D.Bertaccini, M.Ng, Band-Toeplitz Preconditioned GMRES Iterations for time-dependent PDEs. BIT 43(2003), 901-914
[7] M.Bertero, P.Boccacci, Introduction to Inverse Problems in Imaging, IOP Publ., Bristol, 1998
[8] M.Bertero, P.Boccacci, F.Di Benedetto, M.Robberto, Restoration of chopped and nodded images in infrared astronomy. Inverse Problems 15(1999), 345-372
[9] D.Bindi, P.Brianzi, F.Di Benedetto, A Fourier approach to the natural pixel discretization of brain single-photon emission computed tomography. Int. J. of Imaging Syst. and Technol. 12(2002), 1-8
[10] D.Bini, F.Di Benedetto, A new preconditioner for the parallel solution of positive definite Toeplitz linear systems. Proc. 2nd SPAA conf. Crete (Greece), 1990, 220-223
[11] D.Bini, L.Gemignani, V.Pan, Inverse power and Durand-Kerner iterations for univariate polynomial root-finding. Comput. Math. Appl., in press
[12] D.Bini, B.Meini, Effective methods for solving banded Toeplitz systems. SIAM J. Matr. Anal. Appl. 20(1999), 700-719
[13] D.Bini, V.Pan, Polynomial and Matrix Computation: Vol.1, Fundamental Algorithms. Birkauser, Boston, MA, 1994
[14] A.Björck, P.Heggernes, P.Matstoms, Methods for large scale total least squares problems. SIAM J. Matr. Anal. Appl. 22(2000), 413-429.
[15] A.Boettcher, B.Silbermann, Introduction to Large Truncated Toeplitz Matrices. Springer, NY, 1999
[16] P.Brianzi, A criterion for the choice of a sampling parameter in the problem of Laplace transform inversion. Inverse Problems 10(1994), 55-61
[17] R.Chan, T.Chan, L.Shen, Z.Shen, Wavelet deblurring algorithms for spatially varying blur from high-resolution image reconstruction. Linear Algebra Appl. 366(2003), 139-155
[18] R.Chan, M.Ng, Conjugate gradient methods for Toeplitz systems. SIAM Rev. 38(1996), 427-482
[19] R.Chan, D. Potts, G. Steidl, Preconditioners for nondefinite Hermitian Toeplitz systems. SIAM J. Matr. Anal. Appl. 22(2000), 647-665
[20] M.Chu, V.Pauca, R.Plemmons, X.Sun, A Mathematical Framework for the Linear Reconstructor Problem in Adaptive Optics. Linear Algebra Appl. 316(2000), 113-135
[21] F.Di Benedetto, Analysis of preconditioning techniques for ill-conditioned Toeplitz matrices. SIAM J. Sci. Comp. 16(1995), 682-697
[22] F.Di Benedetto, Preconditioning of block Toeplitz matrices by sine transforms. SIAM J. Sci. Comp. 18(1997), 499-515
[23] F.Di Benedetto, Solution of Toeplitz normal equations by sine transform based preconditioning. Linear Algebra Appl. 285(1998), 229-255
[24] F.Di Benedetto, S.Serra Capizzano, A unifying approach to abstract matrix algebra preconditioning. Numer. Math. 82(1999), 57-90
[25] H.Engl, M.Hanke, A.Neubauer, Regularization of Inverse Problems, Kluwer Academic Publishers, Dordrecht, The Netherlands, 1996
[26] C.Estatico, A class of filtering superoptimal preconditioners for highly ill conditioned linear systems. BIT 42(2002), 753-778
[27] C.Estatico, A.Tamasan, A Newton linearization approach for solving the atmospheric retrieval problem. Tech. Rep., UCLA, 2003
[28] D.Fasino, Rational Krylov matrices and QR steps on Hermitian diagonal-plus-semiseparable matrices. Num. Lin. Alg. Appl., to appear
[29] D.Fasino, L.Gemignani, Structural and computational properties of possibly singular semiseparable matrices. Linear Algebra Appl. 340(2002), 183-198
[30] D.Fasino, N.Mastronardi, M.Van Barel, Fast and stable algorithms for reducing diagonal plus semiseparable matrices to tridiagonal and bidiagonal form. Contemporary Mathematics 323(2003), 105-118
[31] G.Fiorentino, S.Serra Capizzano, Multigrid methods for symmetric positive definite block Toeplitz matrices with nonnegative generating functions. SIAM J. Sci. Comp. 17(1996), 1068-1081
[32] M.Hanke, J.Nagy, R.Plemmons, Preconditioned iterative regularization for ill-posed problems. Numerical Linear Algebra and Scientific Computing, de Gruyter, 1993, 141-163
[33] A.Jain, Fundamentals of Digital Image Processing. Prentice-Hall, Englewood Cliffs, NJ, 1989
[34] T.Kailath, V.Olshevsky, Displacement structure approach to discrete-trigonometric-transform based preconditioners of G.Strang type and T.Chan type. Calcolo 33(1996), 191-208
[35] T.Kailath, A.Sayed, Displacement structure: theory and applications. SIAM Rev. 37(1995), 297-386
[36] S.Kamvar, H.Haveliwala, C.Manning, G.Golub, Exploiting the block structure of the Web for computing PageRank. Tech. Rep., Stanford Univ., 2003
[37] M.Ng, R.Chan, W.C.Tang, A fast algorithm for deblurring models with Neumann boundary conditions. SIAM J. Sci. Comput. 21(1999), 851-866
[38] S.Serra Capizzano, Preconditioning strategies for asymptotically ill-conditioned block Toeplitz systems. BIT 34(1994), 579-594
[39] S.Serra Capizzano, Preconditioning strategies for Hermitian Toeplitz systems with nondefinite generating functions. SIAM J. Matr. Anal. Appl. 17(1996), 1007-1019
[40] S.Serra Capizzano, Optimal, quasi-optimal and superlinear preconditioners for asymptotically ill-conditioned positive definite Toeplitz systems. Math. Comp. 66(1997), 651-665
[41] S.Serra Capizzano, On the extreme eigenvalues of Hermitian (block) Toeplitz matrices. Linear Algebra Appl, 270(1998), 109-129
[42] S.Serra Capizzano, An ergodic theorem for classes of preconditioned matrices. Linear Algebra Appl. 282(1998), 161-183
[43] S.Serra Capizzano, Asymptotic results on the spectra of block Toeplitz preconditioned matrices. SIAM J. Matr. Anal. Appl. 20(1998), 31-44
[44] S.Serra Capizzano, Superlinear PCG methods for symmetric Toeplitz systems. Math. Comp. 68(1999), 793-803
[45] S.Serra Capizzano, Korovkin tests, approximation, and ergodic theory. Math. Comp. 69(2000), 1533-1558
[46] S.Serra Capizzano, Matrix algebra preconditioners for multilevel Toeplitz matrices are not superlinear. Linear Algebra Appl. 343/344(2002), 303-319
[47] S.Serra Capizzano, Convergence analysis of two-grid methods for elliptic Toeplitz and PDEs Matrix-sequences. Numer. Math. 92(2002), 433-465
[48] S.Serra Capizzano, A note on anti-reflective boundary conditions and fast deblurring models. SIAM J. Sci. Comput. 25(2003), 1307-1325
[49] S.Serra Capizzano, C.Tablino Possio, Finite Element matrix-sequences: the case of rectangular domains. Numer. Alg. 28(2001), 309-327
[50] S.Serra Capizzano, C.Tablino Possio, Analysis of preconditioning strategies for collocation linear systems. Linear Algebra Appl. 369(2003), 41-75
[51] S.Serra Capizzano, C.Tablino Possio, Superlinear preconditioners for Finite Differences linear systems. SIAM J. Matr. Anal. Appl. 25(2003), 152-164
[52] S.Serra Capizzano, P.Tilli, Extreme singular values and eigenvalues of non Hermitian Toeplitz matrices. J. Comp. Appl. Math. 108(1999), 113-130
[53] S.Serra Capizzano, E.Tyrtyshnikov, Any circulant-like preconditioner for multilevel matrices is not superlinear. SIAM J. Matr. Anal. Appl. 21(1999), 431-439
[54] G.Strang, A proposal for Toeplitz matrix calculations. Stud. Appl. Math. 74(1986), 171-176
[55] P.Tilli, Locally Toeplitz sequences: spectral properties and applications. Linear Algebra Appl. 278(1998), 91-120
[56] E.Tyrtyshnikov, N.Zamarashkin, Spectra of multilevel Toeplitz matrices: advanced theory via simple matrix relationships. Linear Algebra Appl. 270(1998), 15-27


2.5 Descrizione del programma e dei compiti dell'Unità di Ricerca
The new program is organized along two directions that were the main themes considered in the project 2002-2003:
A) Theoretical and computational properties of structured matrices;
B) Structured matrix tools in applied problems.
The topics considered in A) are open problems in structured numerical linear algebra which represent natural continuations of investigations performed in the previous project. Special emphasis will be devoted to less investigated structures (such as shifted, semi-separable matrices, new matrix algebras related to the sine transform of type I, "spectral fattening" of circulant-like/trigonometric algebras): the first three structures have received particular attention in the most recent literature and in applications, while the last is a really new proposal trying to combine the idea of circulant-like and sparse approximate inverse preconditioners.
The main applications considered in B) are again functional approximation, inverse problems, PDEs. Here, in addition to the continuation of previous researches, the group will investigate new applied problems and/or some completely new approaches, often based on advanced tools that are recently developed in the context of structured matrices.
The essential difference with respect to the 2002-2003 project concerns the weights of themes A) and B): more emphasis will be given to (real world) applications. A detailed description of the specific points of the program is reported below.

A1) Theoretical issues
a) Asymptotical linear algebra
The powerful results obtained so far will be applied to the convergence analysis of iterative methods. In particular, if matrices show some distribution property for the eigenvalues and a statistical approach to the error analysis is considered, we want to investigate the role of the distribution function: we believe that its behavior is responsible to this statistical behavior as the spectral radius is in the deterministic setting.
The picture concerning the asymptotical spectral analysis (distribution, localization, extremal behavior) of structured matrices of Toeplitz and Locally Toeplitz type (including PDEs with variable coefficients and on involved geometries) is quite complete now: it remains to understand the extremal behavior (spectral conditioning) in the multidimensional setting following the approach of Bottcher and Grudsky.
In a more non-structured framework, due to interest in convergence theory of Krylov methods, we will study how to deduce spectral clustering of the eigenvalues (proper or general) from a spectral clustering of the singular values for which much more tools are avalaible.
b) Relations between structures
The interplay between diagonal-plus-semiseparable matrices and rational Krylov matrices, firstly outlined in [28], is a rational counterpart of the well-known connection between tridiagonal matrices and classical Krylov matrices. We intend to further this study in order to analyze properties of rational variants of the Krylov iteration, and to deepen the theoretical and computational properties of orthogonal rational functions.
A2) Numerical methods
a) Parametric matrices
A sequence of linear systems is called parametric if it can be represented as {Aj xj = bj} where Aj=A+vj Ej and vj is a scalar parameter; this description generalizes the simpler case of shifted matrices. We plan to focus our attention to incomplete updated factorizations for parametric sequences of linear systems such that
i) A nonsymmetric positive definite and Ej=I (shifted case), and
ii) A symmetric (definite and indefinite) and Ej is banded,
cases which are crucial in the related applications.
For instance, shift-and-invert (SI), inverse power (IP) and Jacobi-Davidson (JD) are popular techniques for the computation of some (typically few) eigenvalues and eigenvectors for large and sparse Hermitian problems. We stress that the core of these algorithms require the efficient solution of several large (and usually indefinite) algebraic systems in shifted form. We plan to follow two main paths to solve the underlying problems:
(i) ad-hoc indefinite incomplete updated factorization preconditioners used with a suitable Krylov projection method;
(ii) solution of shifted systems by projection techniques and multilevel incomplete factorization preconditioned algorithms, with reorderings to transform the original problem in a more diagonally dominant one.
Another application involves the solution of large and sparse total least squares (TLS) problems based on Rayleigh quotient iteration. In this approach, the solution of the underlying problem reduces to the solution of a sequence of shifted symmetric positive definite linear systems. In [14] Björck et al. proposed solving these linear systems by the conjugate gradient method preconditioned by the (complete) Choleski factorization of the normal system matrix. We plan to design and analyze iterative algorithms which generate sequences of linear systems whose condition numbers are better, by using techniques based on incomplete updated and updated approximate inverse factorizations.
b) Semiseparable structures
Matrices with generalized semiseparable structures are gaining a great interest as computational tool to solve eigenvalue problems. The recent research in this field has opened new perspectives for what concerns the design of efficient numerical algorithms for special eigenvalue problems, e.g., associated with generalized companion or quasi-unitary Hessenberg matrices.
Moreover, we want to understand the computational relevance of prescribing the diagonal term in the similarity transformation of a symmetric matrix into diagonal-plus-semiseparable form, in order to speed up the computation of its eigenvalues.
c) Multilevel structures
We are interested in the analysis and in the synthesis of fast algorithms for the solution of multilevel structured linear systems (analysis of preconditioners for the conjugate gradient method, of the associated properties of clustering and spectral equivalence, and analysis of multigrid methods with a special emphasis in the choice of the projector/smoother pair). More in detail, we will be interested in the following aspects:
- Preconditioning of multilevel Toeplitz structures, trying to generalize to the multivariate case the optimality results given in [40].
- Investigation of a ''fattening'' of algebras, by taking matrices of the form U T U* where T is a matrix with a given sparsity pattern and for which the solution of an associated linear system has a complexity bounded by the cost of multiplying U or U* by a vector (typically O(n log n) operations). We would like to understand if this new proposal, which sensibly enriches the ordinary algebras where T is just diagonal, is sufficient for finding preconditioners which are superlinear and/or optimal in the multilevel polynomially ill-conditioned case (which is impossible if T is diagonal).
- Extension of the multigrid optimality proof in [2] to the multilevel case and applications to image restoration problems (see B2-a) and to the PDEs (especially in connection with the dense structured systems arising from the Sinc-Galerkin methods applied to elliptic PDEs).
B1) Continuation of previous research topics
a) Approximation by rational functions
We want to pursue our previous research on interpolation and approximation problems with rational functions, particularly with respect to the analysis of structured conditioning issues and optimal pole placements.
b) Inverse problems in imaging
If we use iterative solvers for linear inverse problems, the iteration number represents a regularization parameter; therefore a first goal is the automatic estimate of such parameter. Another direction involves the extension of regularizing families of preconditioners (e.g. filtering optimal and superoptimal, as described in the Scientific Background) to the reconstruction of non-negative images, and their application to problems related to the adaptive optics device equipping the LBT system.
We also plan the analysis and design of new efficient algorithms for linear systems generated by Tikhonov-like regularization. We would restrict our attention to regularization operators representing the identity, the first or the second derivative. The related normal equations are of parametric form, and should be solved for several values of the Tikhonov parameter. The proposed algorithms are new iterative methods using updated incomplete factorizations generalizing those introduced in [3] (which can be applied directly if the least squares are penalized by means of the solution norm).
Finally, a large amount of work is necessary to optimize the image reconstruction algorithms (i.e. OS-EM method for multiple images). For instance, the LBT restoration problem will require the treatment of images with very high-dynamic range (young binary stars or extrasolar planets). In such a case, the problem will be investigated along two different lines. The first one concerns the study of an appropriate functional in order to take into account the particular features of the object. The second one is a sophisticated post-reconstruction denoising in order to preserve both huge gradients and weak structures.
c) PDEs
The convergence properties of the preconditioned GMRES solution will be investigated for linear systems discretizing the convection-diffusion equation with variable diffusion coefficient. The preconditioner is based on the diffusive part of the operator and we plan to consider a finite difference discretization on a d-dimensional rectangular domain. We plan to show the existence of a proper cluster for the eigenvalues of the preconditioned matrix and then the superlinear behavior of iterations. A preliminary analysis has shown that the structure of the cluster is not influenced by the discretization but the number of outliers linearly increases with respect to the viscosity parameter.
The same techniques will be applied to time-dependent convection-diffusion equations arising in a human metabolism model, which has been introduced at the MIMS center of Cleveland.
B2) New techniques
a) Regularization by multigrid
It is well known that for retrieving the real image from the observed one corrupted by blurring and by noise, it is necessary to resort to some regularizing methods. There exist many procedures in this direction as Tikhonov, Riley, iterative methods as CG, CGNE, Landweber etc (see [25]). However often the most precise ones are also terribly slow. We would like to investigate the possibility of using a multigrid technique (based on the algebraic approach in [2,47]) for the regularization problem as well. Our goals are the following:
- obtain the same reconstruction quality as the best regularizing methods but with a great saving in computation time;
- adapt the method to every boundary condition (see the subsequent point b)) because the algebraic method described in [2] is very versatile with respect to the different structures.
b) Boundary condition effects
We concentrate our efforts in the direction of anti-reflective BCs by considering two goals:
- a more precise analysis of the (non-canonical i.e. mixed structures) algebra of matrices appearing with the anti-reflective BCs;
- the study of the role of the noise and more precisely how to use a regularizing method (which is necessary due to the noise and to the ill-posedness of the problem) in connection with the anti-reflective BCs: we would like to modify the classical normal equations and Tikhonov techniques in such a way that the structure of algebra of the resulting system is exploited in the best possible way. It is understood that the main aim is to obtain a better precision with respect to regularizing methods applied with the other BCs.
c) Denoising and edge detection by wavelets
Astronomical images are corrupted by a large amount of noise. Denoising methods are required in many cases, and in particular we will investigate three cases: chopped and nodded images (near-infrared images), measured PSFs used in classical restoration methods, over-iterated reconstruction. The study will be performed using wavelet-based shrinkage methods in order to optimize for any problem the suitable threshold method.
Moreover, it is well known that the wavelet approach can be especially successful in detecting the edges of an image. We would like to study the following research themes:
- finding a relation between the classical wavelet methods for deblurring of images (noisy and blurred) and the multigrid methods (see B2-a) for deblurring of images (noisy and blurred);
- incorporate the more precise anti-reflective BCs (see B2-b)) into a wavelets framework in order to improve the precision of the resulting reconstruction.
B3) New applications
a) Nonlinear inverse problems
The two-level "Quasi-Newton" approach previously implemented for Remote Sensing problems, as described in the Scientific Background, has revealed the possibility of using structured matrix tools in the new applicative context of nonlinear inverse problems. In this project we plan to apply the same technique to a non-linear inverse scattering problem arising in electrical engineering, where the dielectric permittivity has to be determined.
b) Web search engines
Here the structure that dominates the problem is indicated by the key words "sparsity" and "block structure": a further rank-one matrix multiplied by 1-c, 0<c<1, is added for modelistic reasons (see [36]). When c is far from one, the computation of the positive PageRank(c) vector (left stationary vector) can be performed quite fastly by the standard power method since the second large eigenvalue has at most modulus c. However, if c is close to 1 then the technique is too slow also due to the huge size of the WEB matrix. We would like to express the positive vector PageRank(c) as a rational expansion of PageRank(1) in such a way that its computation can be obtained eventually through vector extrapolation methods.
c) Identification problems
Non-classical inverse eigenvalue problems for tridiagonal matrices and other closely related matrix structures (also including diagonal-plus-semiseparable matrices) are recently arising as models in identification problems in civil engineering, where localized damages or constitutive coefficients in (multilayer) rods and frames are to be detected from measures of frequency responses or resonances. We are aimed at solving both theoretical and computational issues arising in this framework, e.g., identifiability results, perturbative analysis, and synthesis of numerical methods to identify a properly structured matrix from spectral data.

All the research themes considered here require numerical validations and the development of dedicated prototype software. Hence the group needs to incorporate additional young people, for which a substantial part of funding will be used: temporary research positions, fellowships and occasional jobs are planned to start during the two years of the project.
The group includes researchers of several different universities and a strong cooperation is needed to obtain the expected results, also with the help of external collaborators: M.Benzi, Atlanta-USA (topics A2-a), D.Calvetti and G.Saidel, Ohio-USA (topic B1-c), G.Golub, Stanford-USA (topics A1-a, A2-a, B1-c), A.Morassi, Udine-Italy (topic B3-c), D.Noutsos and P.Vassalos, Ioannina-Greece (topics A1-a, A2-c), M.Pastorino, DIBE Genova-Italy (topic B3-a), M.Tasche, Rostock-Germany (topic B2-c) and people of other groups in this project (point A2-b).
Therefore the funding will cover also several travel expenses due to individual meetings and participation to conferences.



2.8 Mesi uomo complessivi dedicati al programma


Numero Mesi uomo
1° anno
Mesi uomo
2° anno
Totale mesi uomo
University Personnel  3  15  13  28 
Other University Personnel  5  28  30  58 
Work contract (research grants, free lance contracts)  1  9  7  16 
PHD Fellows & PHD Students  PHD Students  0       
Post-Doctoral Fellows  0       
Specialization School  0       
Personnel to be hired  Work contract (research grants, free lance contracts)  1  9  7  16 
PHD Fellows & PHD Students  0       
PHD Students  0       
Other tipologies  0       
No cost Non University Personnel  0       
TOTALE     10  61  57  118 


.