I created a matrix by this code
\documentclass{article}
\usepackage{amsmath}
\begin{document}
\[
A_{n+1}=
\begin{pmatrix}
a & \begin{tabular}{ccccc}
0 & 0 & \ldots & 0 & 0 \\
\end{tabular}
& 1\\
\begin{tabular}{c}
0\\
\vdots\\
\end{tabular} & A_n
& \begin{tabular}{c} 0\\
\vdots
\end{tabular}
\\
1 & \begin{tabular}{ccccc}
0 & 0 & \ldots & 0 & 0 \\
\end{tabular} & a\\
\end{pmatrix}
\]
\end{document}
But I don't like the result because the margin between the "a" and the first "0" in the first line is too large. I guess it's due to the tabular environment. Anyway to improve it?


egregprovided the best answer, but just give@{}will produce almost the same output ofegregsuggestion, and the code is\begin{tabular}{@{}c@{}}