In this work, we use two different resolution thermal camera to play the role
of low-resolution and high-resolution camera. For low-resolution camera, we use
Grid-EYE thermal camera. Grid-EYE is a thermal camera that can output
$8\times8$ pixels thermal data with $2.5^\circ C$ accuracy and $0.25^\circ C$
resolution at $10$ fps. For the high-resolution one, we use Lepton 3. The
specification of them are shown in Table~\ref{table:specification of devices}.
\begin{table}[hb]
\begin{table}[hb]
\centering
\centering
\footnotesize
\footnotesize
@ -63,12 +55,20 @@ specification of them are shown in Table~\ref{table:specification of devices}.
Data Rate & 7.68 kbps & 2.34 mbps\\
Data Rate & 7.68 kbps & 2.34 mbps\\
\hline
\hline
\end{tabular}
\end{tabular}
\caption{Specification of Grid-EYE~\cite{grideye_datasheet} and Lepton 3~\cite{lepton_datasheet}.}
\label{table:specificationofdevices}
\caption{Specification of Grid-EYE and Lepton 3.}
\label{table:specificationofdevices}
\end{table}
\end{table}
\subsection{Thermal cameras}
In this work, we use two different resolution thermal camera to play the role
of low-resolution and high-resolution camera. For low-resolution camera, we use
Grid-EYE thermal camera. Grid-EYE is a thermal camera that can output
$8\times8$ pixels thermal data with $2.5^\circ C$ accuracy and $0.25^\circ C$
resolution at $10$ fps. For the high-resolution one, we use Lepton 3. The
specification of them are shown in Table~\ref{table:specificationofdevices}.
\subsection{Related Works}
\subsection{Related Works}
X. Chen et al.~\cite{7805509} proposed to use the visible camera as a guidance to super resolution the IR images. They proposed the IR-RBG multi-sensor imaging system. The approach bases on the fact that RGB channels have different correlation with IR images. To avoid wrong texture transfer, the method used cross correlation to find the proper matching between the region of IR image and RGB image. Next, the method applied sub-pixel estimation and guided filtering to remove the noise and discontinuities in IR image. At the last step of the iteration, they used truncated quadric model as the cost function to terminate the algorithm. After the iteration, the method fine tuned the output IR image with outlier detection to remove the black points which only appear at the edge of IR image.
%X. Chen et al.~\cite{7805509} proposed to use the visible camera as a guidance to super resolution the IR images. They proposed the IR-RBG multi-sensor imaging system. The approach bases on the fact that RGB channels have different correlation with IR images. To avoid wrong texture transfer, the method used cross correlation to find the proper matching between the region of IR image and RGB image. Next, the method applied sub-pixel estimation and guided filtering to remove the noise and discontinuities in IR image. At the last step of the iteration, they used truncated quadric model as the cost function to terminate the algorithm. After the iteration, the method fine tuned the output IR image with outlier detection to remove the black points which only appear at the edge of IR image.
@ -77,7 +77,7 @@ X. Chen et al.~\cite{7805509} proposed to use the visible camera as a guidance t
%\end{center}
%\end{center}
%\end{figure}
%\end{figure}
F. Almsari et al.~\cite{8713356} applied Generative Adversarial Network (GAN) to the super-resoltuion problem called {\it TIGAN}. TIGAN consists of two networks, generator and discriminator, which learn from each other with zero-sum games and try to find an equilibrium state. The generator was trained to transfer low-resolution thermal image into super-resolution thermal image domain. The generated image should be similar to its ground truth high-resolution image domain. While the discriminator was trained to discriminate between generated image and ground truth high-resolution image. Compared to SRCNN model, it preserves the high-frequency details and gave shaper textures.
%F. Almsari et al.~\cite{8713356} applied Generative Adversarial Network (GAN) to the super-resoltuion problem called {\it TIGAN}. TIGAN consists of two networks, generator and discriminator, which learn from each other with zero-sum games and try to find an equilibrium state. The generator was trained to transfer low-resolution thermal image into super-resolution thermal image domain. The generated image should be similar to its ground truth high-resolution image domain. While the discriminator was trained to discriminate between generated image and ground truth high-resolution image. Compared to SRCNN model, it preserves the high-frequency details and gave shaper textures.
%\begin{figure}[hb]
%\begin{figure}[hb]
%\begin{center}
%\begin{center}
@ -88,4 +88,4 @@ F. Almsari et al.~\cite{8713356} applied Generative Adversarial Network (GAN) to
%\end{figure}
%\end{figure}
%% background
%% background
The assumption on the resolution of thermal images in above works is at least $120\times160$. Compared to the $8\times8$ thermal images collected by Grid-EYE sensors, more thermal features are available. In addition, these works use RGB images as reference to train the model. In this work, RGB camera will not be used so as to protect privacy.
The assumption on the resolution of thermal images in above works is at least $120\times160$. Compared to the $8\times8$ thermal images collected by Grid-EYE sensors, more thermal features are available. In addition, these works use RGB images as reference to train the model. In this work, RGB camera will not be used so as to protect privacy.
Hobe
5 years ago