Reach Us +447482877761
Efficient Image Resolution Enhancement Using Edge-Directed Unsharp Masking Sharpening for Real-Time ASIC Applications | OMICS International
ISSN: 0974-7230
Journal of Computer Science & Systems Biology

Like us on:

Make the best use of Scientific Research and information from our 700+ peer reviewed, Open Access Journals that operates with the help of 50,000+ Editorial Board Members and esteemed reviewers and 1000+ Scientific associations in Medical, Clinical, Pharmaceutical, Engineering, Technology and Management Fields.
Meet Inspiring Speakers and Experts at our 3000+ Global Conferenceseries Events with over 600+ Conferences, 1200+ Symposiums and 1200+ Workshops on Medical, Pharma, Engineering, Science, Technology and Business

Efficient Image Resolution Enhancement Using Edge-Directed Unsharp Masking Sharpening for Real-Time ASIC Applications

Kuo-Shiuan Peng1, Fang-Cheng Lin2* and Kai-Tung Teng2

1Department of Electronic and Computer Science, University of Arizona, 1230 E. Speedway Blvd. P.O. Box 210104 Tucson, AZ 85721-0104, USA

2Department of Photonics and Display Institute, National Chiao Tung University, 30010 Hsinchu, Taiwan

*Corresponding Author:
Fang-Cheng Lin
Department of Photonics and Display Institute
National Chiao Tung University
30010 Hsinchu, Taiwan
Tel: 03-5712121 turn 59353
Fax: 03-5737681
Email: [email protected]

Received date: April 24, 2015; Accepted date: May 13, 2015; Published date: May 15, 2015

Citation: Peng KS, Lin FC, Teng KT (2015) Efficient Image Resolution Enhancement Using Edge-Directed Unsharp Masking Sharpening for Real-Time ASIC Applications. J Comput Sci Syst Biol 8:174-184. doi: 10.4172/jcsb.1000186

Copyright: ©2015 Peng KS, et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.

Visit for more related articles at Journal of Computer Science & Systems Biology


This paper proposes the edge-directed unsharp masking sharpening (EDUMS) method and demonstrates the method’s ability to provide single-image resolution enhancement. The EDUMS method implements an efficient single-image, super-resolution process by synergizing edge-directed information and unsharp masking sharpening. This study designs a simple and robust edge information detection process for unsharp masking sharpening that is used to produce a clear edge structure and vivid details of high-resolution images with minimal ringing and jaggy artifacts. This method is a non-iterative process that is computationally efficient for use in a real-time integrated circuit design implementation.


Directed edge; Image resolution enhancement; Super resolution; Unsharp masking sharpening


Recently, the resolution of flat panel displays has substantially increased from WXGA resolution (1366 ×7 68 pixels) to UHD resolution (3840 × 2160 pixels). However, the resolutions of most broadcasting content remain in SD (720 × 480 pixels) or HD (1280 × 720 pixels); limited sources exist in FHD (1920 × 1080 pixels), and UHD is rare [1,2]. Therefore, resolution enhancement in video chip applications has attracted substantial attention. A practical implementation for expanding images consists of linear or bicubic interpolation. These methods efficiently increase content pixel resolution; however, these methods also decrease image sharpness due to a loss of edge and detail information. Therefore, an appropriate method for restoring image quality when expanding images by enhancing high-frequency structures must be developed.

In the computer vision field, single-image, super-resolution (SR) technology has been extensively studied [3,4], the iterative and unsharp masking sharpening (UMS) are the two main approaches. The iterative methods include example based multi-resolution SR [3-9] which construct the SR image by learning to different types of training set, Gaussian process regression [10] which use covariance function through the Gaussian process regression to reconstruct the SR image, sparse representation model [11-14] which use the sparse representation model of compressed sensing to recover the SR image, and back projection [15,16] which has the concept of iteratively back projecting the difference between estimated SR image and simulated low-resolution images. Those methods succeed in upscaling vivid SR images, but requiring the iteration process or a training processing and hindering the use of these methods in practical IC designs.

¨On the other hand, a popular method used in video applications is filtering sharpening using the unsharp masking method [17- 21]. Previous studies using this method have produced simple yet important results with enhanced details, which are more potential to be implemented in real-time applications; however, the edge structure may be distorted due to jaggy and ringing artifacts [22], as shown in Figure 1, which prompt the consideration of edge-preserving sharpening techniques [23,24]. However, when the edge structure is preserved, the details in a high-frequency area become flat and may disappear. The filtering sharpening process has limitations in terms of the balance between edge structure reconstruction and detail enhancement.


Figure 1: (a) 3X resolution enhancement using the conventional unsharp masking sharpening and (b) magnified images with ringing and jaggy artifacts.

To address edge reconstruction problems, edge-directed SR techniques have become very popular over the past decade. Gradient detection algorithms are often used to determine edge information in studies on edge reconstruction. A common method is the directional, filter-based [25-27] image enhancement. For example, contourlet-based [28] sharpening can provide eight directional filters that can be used to calculate edge information. Incorporating gradient prior methods, additionally, recently developed edge-directed SR methods [29-34] can recover or simulate the edge structure from a low-resolution source image or a reference image. However, the preparation of the edgedirected information in those methods is computationally complex; thus, these methods are not practical in ASIC applications.

In summary, using iterative methods can reconstruct high image quality but take too much time and cost due to high computational complexity. In contrast, UMS-related methods face the jaggy and ringing artifacts or detail information lost even though these methods are promising for real-time practical ASIC applications. As a result, this paper develops a real-time, single-image, super-resolution method by synergizing unsharp masking sharpening and edge-directed priors with a novel edge detection method. The basic concept is derived from the efficiency of unsharp masking sharpening [17,18,20] and the clear edge structure representation from edge-directed priors [25,28,30]. This study decomposes the edge information for unsharp masking sharpening to resolve jaggy, ringing artifacts that result from the filtering sharpening processes and to improve the computational efficiency of the directional information processes.

Algorithm Flowchart

This paper reviews the basis of the conventional unsharp masking sharpening (conventional UMS) [17-24] process. This process can be modeled with the following equations:

equation                     (1)

where Icums_dlt is the conventional UMS processed delta; Icums is the sharpened result; Ix+i and Iy+j denote neighboring data around the current data I in both the horizontal direction and the vertical direction, respectively, in range k; and Sx and Sy represent the conventional UMS operators in the horizontal direction and the vertical direction, respectively. In this paper, the symbol * represents convolution. The basic consideration was to separately enhance the horizontal and vertical gradients and obtain the sum of all enhancement values. The commonly used sharpening operators, i.e., Sx and Sy, are [-1, 2, -1], [-1, 2, -1]T and [-1, 0, 2, 0, -1], [-1, 0, 2, 0, -1]T, respectively, which are second-order, differential-based filters for different frequency bandwidths. These filters were effective and easily implemented in the conventional UMS; however, substantial aliasing and a lack of directional process produced ringing issues and pronounced jaggy [22], as shown in Figures 1 and 2b. The original image profile in Figure 2a is smooth, after using the conventional UMS, the edge part is distorted with ringing and jaggy artifacts, as shown in Figure 2b, which deteriorated the image quality and fidelity. Figure 2c shows the edge information of the proposed EDUMS method, the edge clarity is enhanced compared to the original image, and further resolved the ringing and jaggy issues in conventional unsharp masking sharpening.


Figure 2: Edge information of (a) Source image. Images simulated using (b) conventional unsharp masking sharpening with substantial ringing and jaggy issues and (c) the proposed EDUMS method.

To address the aforementioned artifacts, this paper proposes the EDUMS method, and the algorithm process flow is shown in Figure 3. The original low-resolution (LR) image in Figure 3a is the only input. EDUMS attempts to produce the high-resolution (HR) image shown in Figure 3f while preserving edge clarity and strengthening the contrast of the details of the original LR image.


Figure 3: The flow of the proposed EDUMS method. (a) The LR image is the input for the bicubic upscaling process. (b) The bicubic upscaling (bicubic US) image is generated. (c) The edge detection function provides the edge-directed information from the bicubic US image. The direction images contain direction and intensity information. (d) Edge-directed sharpening produces the HR edge image. (e) The detail stretch component extracts the HR detail image. (f) The HR output is the fusion of the HR edge and the HR detail images.

The EDUMS kernel contains two parts. First, the unsharp masking sharpening method [17] was used as the basic component of the edge and detail enhancement in Figures 3d and 3e. The unsharp masking filters of the enhancement consist of a horizontal filter and a vertical filter. The most significant improvement of this algorithm is to introduce the edge-directed prior to address ringing and jaggy issues found in the conventional UMS method. The second kernel consists of the edge structure detection function, which is based on the Canny edge detection method [34]. This step provides the edge-directed information that is represented in Figure 3c, including edge direction and intensity. A unique feature of the EDUMS approach is that this edge information can be used to control edge sharpening without ringing and jaggy issues and to adaptively determine the strength between the edge and the details in the fusion function represented in Figure 3f. These details are illustrated in the following section.

Edge-Directed Unsharp Masking Sharpening

Transient improvement has been the premise of various studies on determining the clear edge of an image [23-32]. The gradient prior [27-32] has been extensively adopted to improve the transient along the gradient direction. This method can effectively enhance the edge transient without producing jaggy issues.

However, these methods are computationally complex and expensive. When the gradient information does not correspond to the edge profile, the directional data are not sufficient for enhancing the image resolution. The complexity of the directional data preparation and the robustness of the directional information are critical to efficiently and correctly enhancing the edge transient.

To efficiently achieve image resolution enhancement without producing jaggy and ringing artifacts, EDUMS precisely redefines the edge direction and intensity from the edge information using a Sobel operator. Edge structure detection, ringing and jaggy suppression, and the fusion method are subsequently addressed.

Edge structure detection

Canny edge detection provides stable information about an edge structure [35]. However, this information is abundant and redundant. EDUMS modifies the Canny edge detection method to ensure its suitability for the conventional UMS process. In the Canny edge detection method, the edge detection operators in the horizontal (x) and vertical (y) directions were set as Sobel operators, i.e., Sbx=[-1, 0, 1;-2, 0, 2;-1, 0, 1]/8 and Sby=[1, 2, 1;0, 0, 0;-1, -2, -1]/8, respectively. The edge direction of conventional UMS using conventional Canny edge detection, the image gradients of the x and y axes, were denoted as Gx=Sbx* I and Gy=Sby* I, respectively. The gradient direction using conventional UMS was defined as d=Gy/Gx, while the gradient magnitude was defined as m=|Gx|+|Gy|. Although the edge raw data of the conventional gradient, i.e., E(d, m), are intuitive in the conventional UMS method, E(d, m) is not an efficient index for edge-directed information because the gradient direction d falls between negative infinity and positive infinity, while edge direction is constrained to the vertical direction.

An efficient method for describing the edge direction is to describe the horizontal and vertical components with a ratio. Consequently, this study decomposed the conventional edge information E(d, m) into normalized component edge information Enc(Edx, Ei) (Figure 4), which can describe edges in the normalized component aspects. To precisely and efficiently describe the edge direction, this study normalized the horizontal gradient Gx and the vertical gradient Gy using their absolute sum and decomposed the gradient direction d into the edge directions x and y as Edx and Edy:


Figure 4: The conventional gradient E(d, m) is transferred into the normalized component edge information Enc (Edx, Ei) using EDUMS.

equation                     (2)

where Edx and Edy are the horizontal and vertical direction percentages, respectively, of the gradient direction d. Therefore, the gradient direction d was simply expressed by Edx, which is called the component gradient direction (CGD) and falls between 0 and 1. For the case of |Gx|+|Gy|=0, Edx was set to 0 in this study.

To maintain edge continuity in a noise or weak boundary case, this study defines the edge intensity Ei using the following equation:

equation            (3)

where Ei is the edge intensity, which is remapped to [0, 1] using the edge intensity transfer function Eif(m, Eicor, Eith); Eicor is the coring value for the lower threshold; and Eith is the limit value for the upper threshold. In this step, a weak gradient in Eicor can be removed, and the intensity can be determined according to the relationship between Eicorand Eith.

Ringing and jaggy suppression

After precisely detecting the edges and their intensities, this study suppressed the artifacts of conventional UMS, i.e., edge ringing and jaggy. The ringing issue can be addressed using a common clipping process, which is expressed as follows:

equation           (4)

where Icl(I) is the clipping result of the current pixel I, Imax and Imin are obtained from the surrounding pixel I(x+i,y+j), and the reference range is represented by k, which is generally set to one. However, this clipping process is applied to all of the pixels of the input image. So the image details are suppressed at the same time. The edge becomes clear, while the details become blurred, as shown in Figure 5c.


Figure 5: (a) Source image. (b) Conventional UMS without clipping process. The ringing effect occurs around the edges of the cap. (c) Conventional UMS with clipping process. The edges exhibit no ringing; however, the details become blurred. (d) The proposed EDUMS suppresses the ringing and maintains the details.

In contrast, the clipping process was therefore adopted only for the edge area while using EDUMS. For the continuity of clipping, this study introduced the edge area intensity Eai into the clipping process as follows:

equation           (5)

where Ieicl(Is) is the edge intensity-based clipping result of the current pixel being sharpened (Is), Eai is the edge area intensity, and Ibc is the bicubic-upscaled source image data. The edge-directed clipping method preserves the details according to the edge area intensity. A vivid image without the peaking effect is shown in Figure 5d.

After suppressing the ringing effects, the image jaggy can be detected around the edge. Two types of image jaggy exist. Source jaggy exists in the source image, whereas artificial jaggy is a result of the enhancement process. This study considered the source jaggy to be the pre-process of the edge enhancement prior to the sharpening process. Then, this study addressed the problem of artificial jaggy in the conventional UMS method.

The source jaggy from the discontinuity along the edges may consist of intrinsic data or may be caused by the upscaling process. This study resolved one-pixel source jaggy in the upscaling image Ibc (bicubic US). A commonly used solution is the use of an anti-aliasing filter (AAF) for the entire image [30]. This approach is sufficient for resolving the jaggy issue while simultaneously suppressing the image details because the process is applied to all of the pixels of the input image (Figure 6c). Therefore, this study only applied the AAF to the edge area that was determined using the edge intensity Ei, which is called the edge intensity-based AAF (EIAAF). The process is expressed as follows:

equation           (6)

where Ieiaaf is the synthesized result of the bicubic-upscaled pixel Ibc being applied AAF. The synthesizing weighting is determined by the edge intensity Ei, which means the AAF is only applied to the edge part. This EIAAF method is simple and maintains high-frequency details. The performance of this preprocess is important and can be demonstrated via a comparison of Figure. 6b-6d. The details of the upper spots are well maintained using this EIAAF technique.


Figure 6: (a) Source image with bicubic upscaling. (b) Conventional UMS without AAF process. The jaggy effect occurs for different line angles. (c) Conventional UMS with AAF process. The jaggy effect is suppressed while the image details are blurred. (d) Proposed EDUMS with EIAAF. The AAF process is only applied to the edge area, so the edges remain smooth, and details become clear.

After resolving the source jaggy issue, the artificial jaggy that employs conventional UMS is derived from the lack of a directional process, which can be used to determine the horizontal and vertical enhancement ratio. According to Edge structure detection, this study decomposed the conventional edge information E(d, m) into the normalized component edge information Enc(Edx, Ei). With this normalized information, the edge improvement process used only horizontal and vertical directional data from its component edge information in the enhancement process. The EDUMS is then modeled as follows:

equation           (7)

where Ixeiaaf and Iyeiaaf are the EIAAF pre-processed neighboring horizontal and vertical pixels, respectively, of the bicubic-upscaled pixel; Sxums and Syums represent the unsharp masking sharpening operators in the horizontal and vertical directions, respectively; Gedums is the manual gain used to control the edge transient performance; Iedums_dlt is the EDUMS processed delta; and Iedums is the edge-directed sharpened result, which is simulated in Figure 7c. The edges of lines at different angles are smoothly enhanced without jaggy compared to the conventional UMS method in Figure 7b.


Figure 7: (a) Source image with bicubic upscaling. (b) Conventional UMS. The jaggy effect occurs for different line angles. (c) The proposed EDUMS method creates smooth and clear lines for each angle type.

To enhance edge clarity, this study employed pure horizontal and vertical data, which were filtered with the normalized component edge information Edx and Edy, to simulate directional data and filters without extraneous directional data and filter preparation. The ringing and jaggy issues of conventional UMS were resolved using the normalized component edge information Enc(Edx, Ei). The ringing effect was suppressed without degrading the details, while the jaggy effect was also reduced without using directional data or additional filters. The detail stretch and fusion processes of the EDUMS are illustrated below.

Detail fusion via edge information

After enhancing edge clarity, the detail stretch and fusion processes were performed as follows: First, the detail stretch is the main purpose of conventional UMS, which utilizes the same concept as the back projection method [15]. In a practical implementation, conventional UMS uses a high-pass filter (HPF) instead of the unsharp masking process to maintain high-frequency details. This study utilized an HPF as a detail stretch sharpening kernel (Sdts). Therefore, the detail stretched result Idts can be modeled as follows:

equation           (8)

where Ibc is the bicubic-upscaled source image data, Idts_dlt is the detail stretch- processed delta, and Gdts is the manual gain used to control the detail enhancement rate.

After preparing the edge sharpened image Iedums and the detail sharpened image Idts, the fusion process synthesized these two images according to the edge intensity Ei, which helped to determine the weighting of these two images. The fusion result can be modeled as

equation           (9)

where Ied is the edge image (Figure 3d), and Idt is the detail image (Figure 3e). The final output I’ (Figure 3f) is derived from the weighted summation of Ied and Idt. The edge and detail enhancement rates were independently controlled by the individual gains Gedums and Gdts; stronger gains produce a more sharpened result. The blending ratio between these two images can be determined by the thresholds Eicor and Eith; the lower threshold produces a larger edge area. The fusion process of Ied and Idt enables increased flexibility in the selection of corresponding filters to enhance edges and details. The algorithm protocol of the proposed EDUMS method is shown in Algorithm 1.

Algorithm 1: EDUMS(I)


(Edx, Ei)←Enc(Ibc)

Ieiaaf←Ieiaaf(Ibc, Ei)

Iedums←Iedums(Ieiaaf, Edx)


Ied+Idt←Fusion(Iedums, Idts, Ei)

I^’←Ieicl(Ied+Idt, Ibc, Ei)

Return I’ as the super-resolution image

Function: Upsample(I)

Bicubic interpolation: Ibc←I

Return Ibc

Function: Enc(Ibc)

Normalized component gradient direction: Edx←Ibc

Edge intensity: Ei←Eif(m, Eicor, Eith)

Return (Edx, Ei)

Function: Ieiaaf(Ibc, Ei)

Edge-intensity based AAF:

Ieiaaf←Ei x AAF *Ibc + (1-Ei) x Ibc

Return Ieiaaf

Function: Iedums(Ieiaaf, Edx)

Edge-directed UMS: Iedums←Ieiaaf

Return Iedums

Function: Idts(Ibc)

Conventional UMS: Idts←Ibc

Return Idts

Function: Fusion (Iedums, Idts, Ei)

Fusion process: Ied+Idt←Ei x Iedums + (1-Ei) x Idts

Return Ied+Idt

Function: Ieicl(Ied+Idt, Ibc, Ei)

Edge-intensity based clipping: I’←Ied+Idt

Return I’

Simulation Results and Discussion

The simulation results include A. Quantitative Evaluation and B. Qualitative Evaluation. The quantitative evaluation of image amplification includes the use of the root-mean-square (RMS), peak signal-to-noise ratio (PSNR) and structural similarity (SSIM) indexes [31]. The RMS is the root-mean-square pixel error for the evaluation of the reconstruction performance. The PSNR and SSIM are used for the evaluation of image quality and were processed by the build-in functions of Matlab R2014a. This study also compared the computational efficiency of conventional UMS, and two iterative methods, including sparse representation model (SRM) [14] and iterative Wiener filter (IWF) [16] methods. The qualitative evaluation of the visual quality compared the reconstructed image with jaggy artifact, ringing artifact, detail improvement and edge improvement. Different settings were applied to various examples to evaluate the resulting visual performance.

Quantitative evaluation

The simulation results of the evaluation of EDUMS were based on 2X magnification. The test channel consisted of a luma channel, which was processed using the EDUMS method, and a chroma channel, which was only, magnified using bicubic upscaling. This study reduced the source test images by 50% in the horizontal and vertical directions; these smaller images were used as the input LR image I. The four test images are shown in Figure 8.


Figure 8: Source test images in the quantitative evaluation. (a) Lena (512 × 512 pixels). (b) Girl (768 × 512 pixels). (c) Fruits (512 × 512 pixels). (d) Monarch (768 × 512 pixels).

In the pre-process step, the EIAAF was defined as [1, 1, 1; 1, 8, 1; 1, 1, 1]/16. According to the test conditions, this study selected sharpening operators that contained both high frequencies and middle frequencies as follows:


Here, Sxums1, Sxums2, Syums1, Syums2, Sdts1 and Sdts2 were used for the highfrequency and middle-frequency edges and details with gains of Gedums1, Gedums2, Gdts1, and Gdts2, respectively. The edge threshold and gain settings were obtained via manual fine tuning (Table 1).

eicor eith gedums1 gedums2 gdts1 gdts2
4 16 2.5 1.5 2.5 1.5

Table 1: Quantitative evaluation settings.

The quantitative evaluation results using the RMS, PSNR and SSIM measures in the luma channel with an upscaling factor of two are listed in Table 2. Compared with the conventional bicubic and UMS methods, EDUMS produces a minimal RMS and better PSNR and SSIM values, which means the edge part of the HR images reconstructed by EDUMS have higher similarity with the original HR images. These measures do not improve significantly because the edge part actually only occupy small area of the image. However, the proposed EDUMS methods are found to be substantial better than the conventional UMS method in visual quality, as demonstrated in Figure 9. The reproduced images are discussed later (IV-B).

Image method rms psnr ssim
equation bicubic
con. ums
equation bicubic
con. ums
equation bicubic
con. ums
equation bicubic
con. ums

Table 2: Comparison of the super-resolution images using rms, psnr and ssim in a luma channel with an upscaling factor of two.


Figure 9: The 3X super-resolution results of five test images. (a) Source LR images. Processed images using (b) bicubic upscaling, (c) conventional UMS, (d) Iterative Wiener filter Error! Reference source not found., (e) Sparse representation model Error! Reference source not found. and (f) the proposed EDUMS method.

Additionally, this study tested the computational efficiency of the conventional UMS and proposed EDUMS methods for the luma channel. Two recently developed single-image SR methods for iterative processes, including SRM and IWF, were also compared to emphasize the difference with an upscaling factor of three because the code used by the IWF method only provides three times upscaling. The results were processed using Matlab R2014a on a computer with a 3.11 GHz CPU and 4 GB of RAM. Using the iterative methods of SRM (343608%) and IWF (184441%), the processing times are much higher than those using the conventional UMS (100%) and proposed EDUMS (177%) methods by three orders of magnitude, as shown in Table 3. Considering the processing time (computational complexity), the proposed EDUMS is found to be more promising than iterative methods for real-time IC applications, because EDUMS only added the process of edge detection and edgedirected UMS to the conventional UMS, and simultaneously enhanced the edge and detail information without artifacts. Besides, compared to conventional UMS, the EDUMS approach only increases the average computation time by approximately 80%, which remains promising for real-time applications. Most importantly, the EDUMS method produces much clearer edges and details with minimal jaggy and ringing artifacts.

Image (a) (b) (c) (d) avg.
lr pixels 256Í256 384Í256 256Í256 384Í256 %
con. ums 0.705 sec 1.035 sec 0.672 sec 1.017 sec 100
iwf 1492 sec 1658 sec 1384 sec 1625 sec 184441
srm 2393 sec 3566 sec 2497 sec 3241 sec 343608
edums 1.243 sec 1.798 sec 1.238 sec 1.777 sec 177

Table 3: Computational efficiency of conventional ums (con. ums), iterative wiener filter (iwf) [16], sparse representation model (srm) [14], and edums with an upscaling factor of three.

Qualitative evaluation

Figure 9 compares additional upscaling images produced using the bicubic, conventional UMS, IWF, SRM and proposed EDUMS methods with three times upscaling. Compared to traditional bicubic and UMS methods, EDUMS also improved the sharpness and image details to the same level as did the iterative methods, i.e., IWF and SRM. The proposed EDUMS method properly enhanced the edge and detail area according to edge information; moreover, clipping process was applied to the edge area according to edge intensity, which prevented the detail area from blurring. The EIAAF and edge-directed UMS process prevented the jaggy artifacts, and the edge intensity-based clipping process prevented the ringing artifacts. As a result, the numbers of ringing and jaggy artifacts were substantially reduced. The simplified algorithm makes EDUMS efficient and better suited for real-time application.

This study further increased the upscaling ratio to six using EDUMS and compared the results to the nearest-neighbor method, as shown in Figure 10. The results demonstrate naturally enhanced textures and details with clear edges. Moreover, this study observed that the details were smoothly and naturally stretched by the sharpening filters. The edge structures of the images were well preserved and did not exhibit ringing and jaggy issues. The HR image styles were determined according to the enhancement ratio between the edges and the details, which were controlled by the gains of different frequency filters. By definition, EDUMS produces fine details with soft edges, soft details with strong edges or both fine details and strong edges. This study reproduced these results using a different frequency response combination, which is shown in Figures 11b-11d.


Figure 10: Resolution enhancement results with an up-sampling factor of six. The first row shows the nearest-neighbor interpolation upscaled results, and the second row shows the proposed EDUMS results.


Figure 11: The proposed EDUMS method implemented with different gain ratios. (a) Source LR image using 2X bicubic upscaling. (b) EDUMS is weak (Gedums1=1, Gedums2=2) at middle frequencies; the detail stretch (Gdts1=5, Gdts2=3) is strong at high frequencies. The results show fine details and soft edges. (c) EDUMS is strong (Gedums1=3, Gedums2=5) at middle frequencies; the detail stretch (Gdts1=2, Gdts2=1) is weak at high frequencies. The edges become clear, and the details are soft. (d) Both EDUMS (Gedums1=3, Gedums2=5) and the detail stretch (Gdts1=5, Gdts2=3) are strong. The edges and details are vivid.

Turning to the noisy input, this study added Gaussian white noise to the low-resolution input image with a signal-to-noise ratio (SNR) of 30 dB. Compared to conventional UMS, EDUMS can still create stable and smooth edges, as shown in Figure 12. The results demonstrate that the EDUMS method is robust against noise.


Figure 12: (a) Test image. (b) Resolution enhancement (2X) results of noisy (SNR=30 dB) low-resolution image using the conventional UMS (top) and proposed EDUMS (bottom) methods.


The EDUMS method was used to construct a single-image SR by synergizing edge-directed technology and the conventional UMS method. The EDUMS method minimized the ringing and jaggy issues from the two enhanced images, i.e., enhanced edge and detail images, and generated better quantitative evaluation results with substantially better visual quality compared to conventional UMS. However, comparing to conventional UMS, the processing time was increased by 80%, which was mainly resulted from the convolution process while using Sobel edge detection. Thus, further improvement of computational efficiency could be implemented by developing a much simpler way to detect the edge information. For example, using Robert’s cross operators [36] instead of Sobel operators for edge detection may be a helpful choice. Robert’s cross operators are 2D filters with a 2 × 2 matrix, which means it takes less time for computation while doing the convolution process in hardware implementation. However, the accuracy and fidelity of the detected edge information may be reduced and affect the quality of the reconstructed HR images. Therefore, how to make a balance between computational complexity and edge information suitability should be concerned in the future.

The performance of the EDUMS method was related to the gain ratio of the filter frequency. Because the filter combination is related to the frequency characteristics of the HR images, the EDUMS approach produces a variety of results for different image quality types (Figure 11). Regardless of the filter combination type that is selected for the process, the approach is easily implemented by designers, and the artifacts are well suppressed. However, this finding generates the following questions:

First, how can suitable filters be determined for different scaling ratios? As demonstrated by our results, simple second-order differentialbased filters with different frequency bandwidths constitute an effective solution. Gaussian filters are also available for general users through wiki websites or software packages (e.g., Matlab). Simple 1D filter designs, such as second-order differential-based filters, are suitable for implementation in real-time applications of filter designs. However, these filters exhibit certain basic limitations, including sharpening artifacts. To address these artifacts, the complex filter coefficient and 2D filter design may produce higher frequency details with more aliasing, which requires more complicated algorithms. With the proposed method, the simple 1D filter design becomes viable and suppresses artifacts.

Second, how can effective gain ratios for automatic edge structure similarity reconstruction be determined from LR images or reference images? Although the EDUMS method uses edge information as a generic prior for filter combination, the transient improvement rate is not determined, and no effective prior that is related to the filtering sharpening process has been developed. Manual testing for determining an optimal gain ratio can become either an advantage or a disadvantage. We believe that this requirement suggests a future direction for studies on unsharp masking sharpening SR methods. Filter designs generate edge information and more effective information that can be used to resolve the need for automatic edge structure similarity reconstruction, which is the current trend in various online studies [28-32].


This study proposed an efficient single-image, super-resolution method: the edge-directed unsharp masking sharpening (EDUMS) method. The EDUMS method employs edge directed sharpening to produce a clear and smooth edge structure after upscaling is performed on the low-resolution image; the details are stretched via unsharp masking sharpening from upscaled images. Using normalized component edge information, ringing from filtering sharpening was prevented, and edges jaggy from native or enhanced images were also suppressed without degrading the details. The details were accurately reproduced by stretching the upscaled image without using any other information. High-resolution image types can be intuitively and simply addressed by controlling the gain ratios of the filters’ frequencies. The method preserved the advantages of unsharp masking sharpening and simplified the edge information for addressing the artifacts produced via unsharp masking sharpening. Compared to conventional UMS, the EDUMS approach increases the average computation time by only approximately 80%, which remains promising for real-time applications; however, the EDUMS method produces clearer edges and details. The proposed EDUMS method is simple and efficient and can be implemented in real-time video chip applications due to its use of a non-iterative filtering process.


The authors would like to thank Prof. Yi-Pai Huang and Prof. Han-Ping D. Shieh from NCTU, Taiwan for their valuable discussion. This study is supported by the Ministry of Science and Technology in Taiwan under the following academic project: MOST 103-2218-E-009-012.


Select your language of interest to view the total content in your interested language
Post your comment

Share This Article

Recommended Conferences

Article Usage

  • Total views: 14103
  • [From(publication date):
    May-2015 - Dec 12, 2019]
  • Breakdown by view type
  • HTML page views : 10205
  • PDF downloads : 3898