亲宝软件园·资讯

展开

Java OpenCV拍照

TGITCIC 人气:0

随着我们对环境、Mat基本使用越来越熟练、Java Swing也逐步熟悉了起来。今天我们开始进入OpenCV驱动摄像头的几个使用场景。

环境准备

1.准备好一个USB外接摄像头,我这边使用的有两种,一种是普通的罗技摄像头,一种是双目摄像头(将来用来做活检);

2.eclipse 2021-12版;

3.JDK 11+,因为我们编写swing要使用到Window Builder窗体设计器这个插件。在eclipse 2021-12版里要驱动Windows Builder窗体设计器我们必须要用JDK11及+;

4.使用Windows10环境编程。当然我们也可以使用Mac,但是Mac下如果是JAVA驱动摄像头有一个这样的梗:那就是直接你在eclipse里无法直接调用摄像头,它会报一个“This app has crashed because it attempted to access privacy-sensitive data without a usage description”或者是

OpenCV: not authorized to capture video (status 0), requesting...
OpenCV: can not spin main run loop from other thread, set OPENCV_AVFOUNDATION_SKIP_AUTH=1 to disable authorization request and perform it in your application.
OpenCV: camera failed to properly initialize

这样的错误,这些错误都是因为Mac OS的权限问题导致,它意指你在Mac下没权限去调用Mac内置的一些设备。如果你用的是XCode写Swift那么你可以通过info.plist来解决此问题。但因为是eclipse里启动java main函数,目前在Mac OS下无法解决eclipse内运行驱动Mac外设这一类问题。如果你在Mac OS内,要运行OpenCV Java并驱动摄像头,你必须把项目打成可执行的jar包并且在command窗口下用java -jar 这样的命令去启动它。在启动时你的Mac OS会提示你给这个command窗口要授权,请点击【是】并且用指纹或者是密码授权,然后再次在command窗口运行java -jar opencv应用,你就可以在Mac OS下使用java去驱动摄像头了。因此这为我们的编码调试带来极大的不便,这就是为什么我们使用Windows10环境下开发opencv java的主要原因。

制作主界面

我们的主界面是一个Java Swing的JFrame应用,它长成这个样子

整体结构介绍

我们把屏幕分成上下两个区域,布局使用的是1024*768,带有点击关闭按钮即关闭程序的自由布局:

setDefaultCloseOperation(JFrame.EXIT_ON_CLOSE);
setBounds(100, 100, 1024, 768);
contentPane = new JPanel();
contentPane.setBorder(new EmptyBorder(5, 5, 5, 5));
setContentPane(contentPane);
contentPane.setLayout(null);

上部区域

我们使用一个JPanel来分组叫cameraGroup,这个JPanel也是自由布局

JPanel cameraGroup = new JPanel();
cameraGroup.setBounds(10, 10, 988, 580);
contentPane.add(cameraGroup);
cameraGroup.setLayout(null);

然后在这个cameraGroup以左大右小,放置了两个额外的JPanel:

其中的videoCamera是自定义的JPanel

protected static VideoPanel videoCamera = new VideoPanel();

它是用来显示摄像头开启时不断的把摄像头内取到的图像“刷”到JPanel上显示用的,代码如下:

package org.mk.opencv;
 
import java.awt.*;
import java.awt.image.BufferedImage;
import javax.swing.*;
 
import org.mk.opencv.util.ImageUtils;
import org.mk.opencv.util.OpenCVUtil;
import org.opencv.core.Mat;
 
public class VideoPanel extends JPanel {
 
    private Image image;
 
    public void setImageWithMat(Mat mat) {
        image = OpenCVUtil.matToBufferedImage(mat);
        this.repaint();
    }
 
    public void SetImageWithImg(Image img) {
        image = img;
    }
 
    public Mat getMatFromImage() {
        Mat faceMat = new Mat();
        BufferedImage bi = ImageUtils.toBufferedImage(image);
        faceMat = OpenCVUtil.bufferedImageToMat(bi);
        return faceMat;
    }
 
    @Override
    protected void paintComponent(Graphics g) {
        super.paintComponent(g);
        if (image != null)
            g.drawImage(image, 0, 0, image.getWidth(null), image.getHeight(null), this);
    }
 
    public static VideoPanel show(String title, int width, int height, int open) {
        JFrame frame = new JFrame(title);
        if (open == 0) {
            frame.setDefaultCloseOperation(JFrame.EXIT_ON_CLOSE);
        } else {
            frame.setDefaultCloseOperation(JFrame.DISPOSE_ON_CLOSE);
        }
 
        frame.setSize(width, height);
        frame.setBounds(0, 0, width, height);
        VideoPanel videoPanel = new VideoPanel();
        videoPanel.setSize(width, height);
        frame.setContentPane(videoPanel);
        frame.setVisible(true);
        return videoPanel;
    }
}

下部区域

下部区域我们放置了一个buttonGroup。这个buttonGroup用的是“网袋布局”,上面放置三个按钮。

JPanel buttonGroup = new JPanel();
buttonGroup.setBounds(65, 610, 710, 35);
contentPane.add(buttonGroup);
buttonGroup.setLayout(new GridLayout(1, 0, 0, 0));

今天我们就要实现photoButton里的功能。

说完了布局下面进入核心代码讲解。

核心代码与知识点讲解

(最后会上全代码)

JPanel中如何显示摄像头的图像

JPanel这种组件一般是套在JFrame的contentPanel里的(这是用图形化设计器生成的JFrame自带的一个用来“盛”其它组件的容器)。

contentPane大家可以认为是一种容器。它一般是这样的一层关系:

JFrame(我们的主类)->contentPane->我们自己的上半部JPanel->videoCamera(JPanel)。

在Java Swing里有一个方法叫repaint()方法,这个方法 一旦被调用,这个组件的“子组件”内的

protected void paintComponent(Graphics g)

都会自动被依次调用一遍。

因此,我们才自定义了一个JPanel叫VideoPanel,然后我们覆写了它里面的paintComponent方法

    @Override
    protected void paintComponent(Graphics g) {
        super.paintComponent(g);
        if (image != null)
            g.drawImage(image, 0, 0, image.getWidth(null), image.getHeight(null), this);
    }

这样,我们在我们的主类“FaceRecognize”里在通过摄像头得到了图像后把图像通过VideoPanel里的“setImageWithMat”方法set后,马上调用FaceRecognize自自的repaint方法,然后“父”事件一路向下传导,依次逐级把子组件进行“刷新”-子组件的paintComponent都会被触发一遍。

摄像头得到图像显示在videoCamera区域的过程就是:

为了取得良好的刷新、连续不断的显示效果,你可以把上述方法套在一个“单线程”内。

OpenCV调用摄像头

OpenCV是使用以下这个类来驱动摄像头的。

private static VideoCapture capture = new VideoCapture();

然后打开摄像头,读入摄像头内容如下

capture.open(0);
Scalar color = new Scalar(0, 255, 0);
MatOfRect faces = new MatOfRect();
if (capture.isOpened()) {
    logger.info(">>>>>>video camera in working");
    Mat faceMat = new Mat();
    while (true) {
        capture.read(faceMat);
        if (!faceMat.empty()) {
            faceCascade.detectMultiScale(faceMat, faces);
            Rect[] facesArray = faces.toArray();
            if (facesArray.length >= 1) {
                for (int i = 0; i < facesArray.length; i++) {
                    Imgproc.rectangle(faceMat, facesArray[i].tl(), facesArray[i].br(), color, 2);
                    videoPanel.setImageWithMat(faceMat);
                    frame.repaint();                                    
                }
            }
        } else {
            logger.info(">>>>>>not found anyinput");
            break;
        }
        Thread.sleep(80);
    }
}

通过上述代码我们可以看到我上面描述的4步。

前面说了,为了让这个过程更“顺滑”、“丝滑”,我把这个过程套到了一个单线程里让它单独运行以不阻塞Java Swing的主界面。同时用“绿色”的方框把人脸在画面里“框”出来。为此我制作了一个函数如下:

    public void invokeCamera(JFrame frame, VideoPanel videoPanel) {
        new Thread() {
            public void run() {
                CascadeClassifier faceCascade = new CascadeClassifier();
                faceCascade.load(cascadeFileFullPath);
                try {
                    capture.open(0);
                    Scalar color = new Scalar(0, 255, 0);
                    MatOfRect faces = new MatOfRect();
                    // Mat faceFrames = new Mat();
                    if (capture.isOpened()) {
                        logger.info(">>>>>>video camera in working");
                        Mat faceMat = new Mat();
                        while (true) {
                            capture.read(faceMat);
                            if (!faceMat.empty()) {
                                faceCascade.detectMultiScale(faceMat, faces);
                                Rect[] facesArray = faces.toArray();
                                if (facesArray.length >= 1) {
                                    for (int i = 0; i < facesArray.length; i++) {
                                        Imgproc.rectangle(faceMat, facesArray[i].tl(), facesArray[i].br(), color, 2);
                                        videoPanel.setImageWithMat(faceMat);
                                        frame.repaint();
                                        // videoPanel.repaint();
                                    }
                                }
                            } else {
                                logger.info(">>>>>>not found anyinput");
                                break;
                            }
                            Thread.sleep(80);
                        }
                    }
                } catch (Exception e) {
                    logger.error("invoke camera error: " + e.getMessage(), e);
                }
            }
        }.start();
    }

配合上我们的main方法就是这样用的:

    public static void main(String[] args) {
        FaceRecognize frame = new FaceRecognize();
        frame.setVisible(true);
        frame.invokeCamera(frame, videoCamera);
    }

使用摄像头拍照

这一章节我们在OpenCV Java入门四 认出这是“一张脸”里其实已经讲过了,就是把一个Mat输出到一个jpg文件中。

在本篇章节中,我们为了做得效果好一点会做这么几件事:

等比例缩放图片

位于ImageUtils类,它得到一个Mat,然后转成java.awt.Image对象;

再利用Image里的AffineTransformOp根据ratio(图像原比例)基于指定尺寸(宽:165, 高:200)的等比例缩放。再把Image转成BufferedImage;

再把BufferedImage转回Mat给到FaceRecognize主类用来作VideoPanel的“显示”来显示到我们的preview区域,而preview区域其实也是用到了VideoPanel这个类来声明的;

为此我们对photoButton进行事件编程

JButton photoButton = new JButton("Take Photo");
        photoButton.addActionListener(new ActionListener() {
            public void actionPerformed(ActionEvent e) {
                logger.info(">>>>>>take photo performed");
                StringBuffer photoPathStr = new StringBuffer();
                photoPathStr.append(photoPath);
                try {
                    if (capture.isOpened()) {
                        Mat myFace = new Mat();
                        while (true) {
                            capture.read(myFace);
                            if (!myFace.empty()) {
                                Image previewImg = ImageUtils.scale2(myFace, 165, 200, true);// 等比例缩放
                                TakePhotoProcess takePhoto = new TakePhotoProcess(photoPath.toString(), myFace);
                                takePhoto.start();// 照片写盘
                                videoPreview.SetImageWithImg(previewImg);// 在预览界面里显示等比例缩放的照片
                                videoPreview.repaint();// 让预览界面重新渲染
                                break;
                            }
                        }
                    }
                } catch (Exception ex) {
                    logger.error(">>>>>>take photo error: " + ex.getMessage(), ex);
                }
            }
        });

TakePhotoProcess是一个单线程,代码如下:

package org.mk.opencv.sample;
 
import org.apache.log4j.Logger;
import org.opencv.core.Mat;
import org.opencv.core.Scalar;
import org.opencv.imgcodecs.Imgcodecs;
 
public class TakePhotoProcess extends Thread {
    private static Logger logger = Logger.getLogger(TakePhotoProcess.class);
 
    private String imgPath;
    private Mat faceMat;
    private final static Scalar color = new Scalar(0, 0, 255);
 
    public TakePhotoProcess(String imgPath, Mat faceMat) {
        this.imgPath = imgPath;
        this.faceMat = faceMat;
    }
 
    public void run() {
        try {
            long currentTime = System.currentTimeMillis();
            StringBuffer samplePath = new StringBuffer();
            samplePath.append(imgPath).append(currentTime).append(".jpg");
            Imgcodecs.imwrite(samplePath.toString(), faceMat);
            logger.info(">>>>>>write image into->" + samplePath.toString());
 
        } catch (Exception e) {
            logger.error(e.getMessage(), e);
        }
    }
 
}

另外两个按钮“trainButton”和"identifyButton"我们留到后面2个篇章里去讲,我们一步一步来,这样大家才能夯实基础。

最终这个FaceRecognize运行起来,然后点击photoButton后的效果如下图所示:

完整代码

OpenCVUtil.java

package org.mk.opencv.util;
 
import java.awt.Image;
import java.awt.image.BufferedImage;
import java.awt.image.DataBufferByte;
import java.util.ArrayList;
import java.util.LinkedList;
import java.util.List;
import java.io.File;
 
import org.apache.log4j.Logger;
import org.opencv.core.CvType;
import org.opencv.core.Mat;
 
 
public class OpenCVUtil {
    private static Logger logger = Logger.getLogger(OpenCVUtil.class);
 
    public static Image matToImage(Mat matrix) {
        int type = BufferedImage.TYPE_BYTE_GRAY;
        if (matrix.channels() > 1) {
            type = BufferedImage.TYPE_3BYTE_BGR;
        }
        int bufferSize = matrix.channels() * matrix.cols() * matrix.rows();
        byte[] buffer = new byte[bufferSize];
        matrix.get(0, 0, buffer); // 获取所有的像素点
        BufferedImage image = new BufferedImage(matrix.cols(), matrix.rows(), type);
        final byte[] targetPixels = ((DataBufferByte) image.getRaster().getDataBuffer()).getData();
        System.arraycopy(buffer, 0, targetPixels, 0, buffer.length);
        return image;
    }
 
    public static List<String> getFilesFromFolder(String folderPath) {
        List<String> fileList = new ArrayList<String>();
        File f = new File(folderPath);
        if (f.isDirectory()) {
            File[] files = f.listFiles();
            for (File singleFile : files) {
                fileList.add(singleFile.getPath());
            }
        }
        return fileList;
    }
 
    public static String randomFileName() {
        StringBuffer fn = new StringBuffer();
        fn.append(System.currentTimeMillis()).append((int) (System.currentTimeMillis() % (10000 - 1) + 1))
                .append(".jpg");
        return fn.toString();
    }
 
    public static List<FileBean> getPicFromFolder(String rootPath) {
        List<FileBean> fList = new ArrayList<FileBean>();
        int fileNum = 0, folderNum = 0;
        File file = new File(rootPath);
        if (file.exists()) {
            LinkedList<File> list = new LinkedList<File>();
            File[] files = file.listFiles();
            for (File file2 : files) {
                if (file2.isDirectory()) {
                    // logger.info(">>>>>>文件夹:" + file2.getAbsolutePath());
                    list.add(file2);
                    folderNum++;
                } else {
                    // logger.info(">>>>>>文件:" + file2.getAbsolutePath());
                    FileBean f = new FileBean();
                    String fileName = file2.getName();
                    String suffix = fileName.substring(fileName.lastIndexOf(".") + 1);
                    File fParent = new File(file2.getParent());
                    String parentFolderName = fParent.getName();
                    f.setFileFullPath(file2.getAbsolutePath());
                    f.setFileType(suffix);
                    f.setFolderName(parentFolderName);
                    fList.add(f);
                    fileNum++;
                }
            }
            File temp_file;
            while (!list.isEmpty()) {
                temp_file = list.removeFirst();
                files = temp_file.listFiles();
                for (File file2 : files) {
                    if (file2.isDirectory()) {
                        // System.out.println("文件夹:" + file2.getAbsolutePath());
                        list.add(file2);
                        folderNum++;
                    } else {
                        // logger.info(">>>>>>文件:" + file2.getAbsolutePath());
                        FileBean f = new FileBean();
                        String fileName = file2.getName();
                        String suffix = fileName.substring(fileName.lastIndexOf(".") + 1);
                        File fParent = new File(file2.getParent());
                        String parentFolderName = fParent.getName();
                        f.setFileFullPath(file2.getAbsolutePath());
                        f.setFileType(suffix);
                        f.setFolderName(parentFolderName);
                        fList.add(f);
                        fileNum++;
                    }
                }
            }
        } else {
            logger.info(">>>>>>文件不存在!");
        }
        // logger.info(">>>>>>文件夹共有:" + folderNum + ",文件共有:" + fileNum);
        return fList;
    }
 
    public static BufferedImage matToBufferedImage(Mat matrix) {
        int cols = matrix.cols();
        int rows = matrix.rows();
        int elemSize = (int) matrix.elemSize();
        byte[] data = new byte[cols * rows * elemSize];
        int type;
        matrix.get(0, 0, data);
        switch (matrix.channels()) {
        case 1:
            type = BufferedImage.TYPE_BYTE_GRAY;
            break;
        case 3:
            type = BufferedImage.TYPE_3BYTE_BGR;
            // bgr to rgb
            byte b;
            for (int i = 0; i < data.length; i = i + 3) {
                b = data[i];
                data[i] = data[i + 2];
                data[i + 2] = b;
            }
            break;
        default:
            return null;
        }
        BufferedImage image2 = new BufferedImage(cols, rows, type);
        image2.getRaster().setDataElements(0, 0, cols, rows, data);
        return image2;
    }
 
    public static Mat bufferedImageToMat(BufferedImage bi) {
        Mat mat = new Mat(bi.getHeight(), bi.getWidth(), CvType.CV_8UC3);
        byte[] data = ((DataBufferByte) bi.getRaster().getDataBuffer()).getData();
        mat.put(0, 0, data);
        return mat;
    }
}

ImageUtils.java

package org.mk.opencv.util;
 
import java.awt.Color;
import java.awt.Graphics;
import java.awt.Graphics2D;
import java.awt.GraphicsConfiguration;
import java.awt.GraphicsDevice;
import java.awt.GraphicsEnvironment;
import java.awt.HeadlessException;
import java.awt.Image;
import java.awt.Transparency;
import java.awt.geom.AffineTransform;
import java.awt.image.AffineTransformOp;
import java.awt.image.BufferedImage;
import java.io.File;
import java.io.IOException;
 
import javax.imageio.ImageIO;
import javax.swing.ImageIcon;
 
import org.opencv.core.Mat;
 
public class ImageUtils {
 
    /**
     * 几种常见的图片格式
     */
    public static String IMAGE_TYPE_GIF = "gif";// 图形交换格式
    public static String IMAGE_TYPE_JPG = "jpg";// 联合照片专家组
    public static String IMAGE_TYPE_JPEG = "jpeg";// 联合照片专家组
    public static String IMAGE_TYPE_BMP = "bmp";// 英文Bitmap(位图)的简写,它是Windows操作系统中的标准图像文件格式
    public static String IMAGE_TYPE_PNG = "png";// 可移植网络图形
    public static String IMAGE_TYPE_PSD = "psd";// Photoshop的专用格式Photoshop
 
    /**
     * 缩放图像(按高度和宽度缩放)
     * 
     * @param srcImageFile 源图像文件地址
     * @param result       缩放后的图像地址
     * @param height       缩放后的高度
     * @param width        缩放后的宽度
     * @param bb           比例不对时是否需要补白:true为补白; false为不补白;
     */
    public final synchronized static Image scale2(Mat mat, int height, int width, boolean bb) throws Exception {
        // boolean flg = false;
        Image itemp = null;
        try {
            double ratio = 0.0; // 缩放比例
            // File f = new File(srcImageFile);
            // BufferedImage bi = ImageIO.read(f);
            BufferedImage bi = OpenCVUtil.matToBufferedImage(mat);
            itemp = bi.getScaledInstance(width, height, bi.SCALE_SMOOTH);
            // 计算比例
            // if ((bi.getHeight() > height) || (bi.getWidth() > width)) {
            // flg = true;
            if (bi.getHeight() > bi.getWidth()) {
                ratio = Integer.valueOf(height).doubleValue() / bi.getHeight();
            } else {
                ratio = Integer.valueOf(width).doubleValue() / bi.getWidth();
            }
            AffineTransformOp op = new AffineTransformOp(AffineTransform.getScaleInstance(ratio, ratio), null);
            itemp = op.filter(bi, null);
            // }
            if (bb) {// 补白
                BufferedImage image = new BufferedImage(width, height, BufferedImage.TYPE_INT_RGB);
                Graphics2D g = image.createGraphics();
                g.setColor(Color.white);
                g.fillRect(0, 0, width, height);
                if (width == itemp.getWidth(null))
                    g.drawImage(itemp, 0, (height - itemp.getHeight(null)) / 2, itemp.getWidth(null),
                            itemp.getHeight(null), Color.white, null);
                else
                    g.drawImage(itemp, (width - itemp.getWidth(null)) / 2, 0, itemp.getWidth(null),
                            itemp.getHeight(null), Color.white, null);
                g.dispose();
                itemp = image;
            }
            // if (flg)
            // ImageIO.write((BufferedImage) itemp, "JPEG", new File(result));
        } catch (Exception e) {
            throw new Exception("scale2 error: " + e.getMessage(), e);
        }
        return itemp;
    }
 
    public static BufferedImage toBufferedImage(Image image) {
        if (image instanceof BufferedImage) {
            return (BufferedImage) image;
        }
 
        // 此代码确保在图像的所有像素被载入
        image = new ImageIcon(image).getImage();
 
        // 如果图像有透明用这个方法
//        boolean hasAlpha = hasAlpha(image);
 
        // 创建一个可以在屏幕上共存的格式的bufferedimage
        BufferedImage bimage = null;
        GraphicsEnvironment ge = GraphicsEnvironment.getLocalGraphicsEnvironment();
        try {
            // 确定新的缓冲图像类型的透明度
            int transparency = Transparency.OPAQUE;
            // if (hasAlpha) {
            transparency = Transparency.BITMASK;
            // }
 
            // 创造一个bufferedimage
            GraphicsDevice gs = ge.getDefaultScreenDevice();
            GraphicsConfiguration gc = gs.getDefaultConfiguration();
            bimage = gc.createCompatibleImage(image.getWidth(null), image.getHeight(null), transparency);
        } catch (HeadlessException e) {
            // 系统不会有一个屏幕
        }
 
        if (bimage == null) {
            // 创建一个默认色彩的bufferedimage
            int type = BufferedImage.TYPE_INT_RGB;
            // int type = BufferedImage.TYPE_3BYTE_BGR;//by wang
            // if (hasAlpha) {
            type = BufferedImage.TYPE_INT_ARGB;
            // }
            bimage = new BufferedImage(image.getWidth(null), image.getHeight(null), type);
        }
 
        // 把图像复制到bufferedimage上
        Graphics g = bimage.createGraphics();
 
        // 把图像画到bufferedimage上
        g.drawImage(image, 0, 0, null);
        g.dispose();
 
        return bimage;
    }
}

FileBean.java

package org.mk.opencv.util;
 
import java.io.Serializable;
 
public class FileBean implements Serializable {
 
    private String fileFullPath;
    private String folderName;
    private String fileType;
 
    public String getFileType() {
        return fileType;
    }
 
    public void setFileType(String fileType) {
        this.fileType = fileType;
    }
 
    public String getFileFullPath() {
        return fileFullPath;
    }
 
    public void setFileFullPath(String fileFullPath) {
        this.fileFullPath = fileFullPath;
    }
 
    public String getFolderName() {
        return folderName;
    }
 
    public void setFolderName(String folderName) {
        this.folderName = folderName;
    }
 
}

VideoPanel.java

package org.mk.opencv;
 
import java.awt.*;
import java.awt.image.BufferedImage;
import javax.swing.*;
 
import org.mk.opencv.util.ImageUtils;
import org.mk.opencv.util.OpenCVUtil;
import org.opencv.core.Mat;
 
public class VideoPanel extends JPanel {
 
    private Image image;
 
    public void setImageWithMat(Mat mat) {
        image = OpenCVUtil.matToBufferedImage(mat);
        this.repaint();
    }
 
    public void SetImageWithImg(Image img) {
        image = img;
    }
 
    public Mat getMatFromImage() {
        Mat faceMat = new Mat();
        BufferedImage bi = ImageUtils.toBufferedImage(image);
        faceMat = OpenCVUtil.bufferedImageToMat(bi);
        return faceMat;
    }
 
    @Override
    protected void paintComponent(Graphics g) {
        super.paintComponent(g);
        if (image != null)
            g.drawImage(image, 0, 0, image.getWidth(null), image.getHeight(null), this);
    }
 
    public static VideoPanel show(String title, int width, int height, int open) {
        JFrame frame = new JFrame(title);
        if (open == 0) {
            frame.setDefaultCloseOperation(JFrame.EXIT_ON_CLOSE);
        } else {
            frame.setDefaultCloseOperation(JFrame.DISPOSE_ON_CLOSE);
        }
 
        frame.setSize(width, height);
        frame.setBounds(0, 0, width, height);
        VideoPanel videoPanel = new VideoPanel();
        videoPanel.setSize(width, height);
        frame.setContentPane(videoPanel);
        frame.setVisible(true);
        return videoPanel;
    }
}

TakePhotoProcess.java

package org.mk.opencv.sample;
 
import org.apache.log4j.Logger;
import org.opencv.core.Mat;
import org.opencv.core.Scalar;
import org.opencv.imgcodecs.Imgcodecs;
 
public class TakePhotoProcess extends Thread {
    private static Logger logger = Logger.getLogger(TakePhotoProcess.class);
 
    private String imgPath;
    private Mat faceMat;
    private final static Scalar color = new Scalar(0, 0, 255);
 
    public TakePhotoProcess(String imgPath, Mat faceMat) {
        this.imgPath = imgPath;
        this.faceMat = faceMat;
    }
 
    public void run() {
        try {
            long currentTime = System.currentTimeMillis();
            StringBuffer samplePath = new StringBuffer();
            samplePath.append(imgPath).append(currentTime).append(".jpg");
            Imgcodecs.imwrite(samplePath.toString(), faceMat);
            logger.info(">>>>>>write image into->" + samplePath.toString());
 
        } catch (Exception e) {
            logger.error(e.getMessage(), e);
        }
    }
 
}

FaceRecognize.java(核心主类)

package org.mk.opencv.sample;
 
import java.awt.EventQueue;
 
import javax.swing.JFrame;
import javax.swing.JPanel;
import javax.swing.border.EmptyBorder;
 
import org.apache.log4j.Logger;
import org.mk.opencv.VideoPanel;
import org.mk.opencv.face.TakePhotoProcess;
import org.mk.opencv.util.ImageUtils;
import org.mk.opencv.util.OpenCVUtil;
import org.opencv.core.Core;
import org.opencv.core.Mat;
import org.opencv.core.MatOfRect;
import org.opencv.core.Rect;
import org.opencv.core.Scalar;
import org.opencv.core.Size;
import org.opencv.imgproc.Imgproc;
import org.opencv.objdetect.CascadeClassifier;
import org.opencv.videoio.VideoCapture;
 
import javax.swing.border.BevelBorder;
import javax.swing.JLabel;
import javax.swing.SwingConstants;
import java.awt.GridLayout;
import java.awt.Image;
import java.awt.event.ActionEvent;
import java.awt.event.ActionListener;
 
import javax.swing.JButton;
 
public class FaceRecognize extends JFrame {
    static {
        System.loadLibrary(Core.NATIVE_LIBRARY_NAME);
    }
    private static Logger logger = Logger.getLogger(FaceRecognize.class);
    private static final String cascadeFileFullPath = "D:\\opencvinstall\\build\\install\\etc\\lbpcascades\\lbpcascade_frontalface.xml";
    private static final String photoPath = "D:\\opencv-demo\\face\\";
    private JPanel contentPane;
    protected static VideoPanel videoCamera = new VideoPanel();
    private static final Size faceSize = new Size(165, 200);
    private static VideoCapture capture = new VideoCapture();
 
    /**
     * Launch the application.
     */
    public static void main(String[] args) {
        FaceRecognize frame = new FaceRecognize();
        frame.setVisible(true);
        frame.invokeCamera(frame, videoCamera);
    }
 
    public void invokeCamera(JFrame frame, VideoPanel videoPanel) {
        new Thread() {
            public void run() {
                CascadeClassifier faceCascade = new CascadeClassifier();
                faceCascade.load(cascadeFileFullPath);
                try {
                    capture.open(0);
                    Scalar color = new Scalar(0, 255, 0);
                    MatOfRect faces = new MatOfRect();
                    // Mat faceFrames = new Mat();
                    if (capture.isOpened()) {
                        logger.info(">>>>>>video camera in working");
                        Mat faceMat = new Mat();
                        while (true) {
                            capture.read(faceMat);
                            if (!faceMat.empty()) {
                                faceCascade.detectMultiScale(faceMat, faces);
                                Rect[] facesArray = faces.toArray();
                                if (facesArray.length >= 1) {
                                    for (int i = 0; i < facesArray.length; i++) {
                                        Imgproc.rectangle(faceMat, facesArray[i].tl(), facesArray[i].br(), color, 2);
                                        videoPanel.setImageWithMat(faceMat);
                                        frame.repaint();
                                        // videoPanel.repaint();
                                    }
                                }
                            } else {
                                logger.info(">>>>>>not found anyinput");
                                break;
                            }
                            Thread.sleep(80);
                        }
                    }
                } catch (Exception e) {
                    logger.error("invoke camera error: " + e.getMessage(), e);
                }
            }
        }.start();
    }
 
    /**
     * Create the frame.
     */
 
    public FaceRecognize() {
 
        setDefaultCloseOperation(JFrame.EXIT_ON_CLOSE);
        setBounds(100, 100, 1024, 768);
        contentPane = new JPanel();
        contentPane.setBorder(new EmptyBorder(5, 5, 5, 5));
        setContentPane(contentPane);
        contentPane.setLayout(null);
 
        JPanel cameraGroup = new JPanel();
        cameraGroup.setBounds(10, 10, 988, 580);
        contentPane.add(cameraGroup);
        cameraGroup.setLayout(null);
 
        JLabel videoDescriptionLabel = new JLabel("Video");
        videoDescriptionLabel.setHorizontalAlignment(SwingConstants.CENTER);
        videoDescriptionLabel.setBounds(0, 10, 804, 23);
        cameraGroup.add(videoDescriptionLabel);
 
        videoCamera.setBorder(new BevelBorder(BevelBorder.LOWERED, null, null, null, null));
        videoCamera.setBounds(10, 43, 794, 527);
        cameraGroup.add(videoCamera);
 
        // JPanel videoPreview = new JPanel();
        VideoPanel videoPreview = new VideoPanel();
        videoPreview.setBorder(new BevelBorder(BevelBorder.LOWERED, null, null, null, null));
        videoPreview.setBounds(807, 359, 171, 211);
        cameraGroup.add(videoPreview);
 
        JLabel lblNewLabel = new JLabel("Preview");
        lblNewLabel.setHorizontalAlignment(SwingConstants.CENTER);
        lblNewLabel.setBounds(807, 307, 171, 42);
        cameraGroup.add(lblNewLabel);
 
        JPanel buttonGroup = new JPanel();
        buttonGroup.setBounds(65, 610, 710, 35);
        contentPane.add(buttonGroup);
        buttonGroup.setLayout(new GridLayout(1, 0, 0, 0));
 
        JButton photoButton = new JButton("Take Photo");
        photoButton.addActionListener(new ActionListener() {
            public void actionPerformed(ActionEvent e) {
                logger.info(">>>>>>take photo performed");
                StringBuffer photoPathStr = new StringBuffer();
                photoPathStr.append(photoPath);
                try {
                    if (capture.isOpened()) {
                        Mat myFace = new Mat();
                        while (true) {
                            capture.read(myFace);
                            if (!myFace.empty()) {
                                Image previewImg = ImageUtils.scale2(myFace, 165, 200, true);// 等比例缩放
                                TakePhotoProcess takePhoto = new TakePhotoProcess(photoPath.toString(), myFace);
                                takePhoto.start();// 照片写盘
                                videoPreview.SetImageWithImg(previewImg);// 在预览界面里显示等比例缩放的照片
                                videoPreview.repaint();// 让预览界面重新渲染
                                break;
                            }
                        }
                    }
                } catch (Exception ex) {
                    logger.error(">>>>>>take photo error: " + ex.getMessage(), ex);
                }
            }
        });
        buttonGroup.add(photoButton);
 
        JButton trainButton = new JButton("Train");
        buttonGroup.add(trainButton);
 
        JButton identifyButton = new JButton("Identify");
        buttonGroup.add(identifyButton);
    }
}

加载全部内容

相关教程
猜你喜欢
用户评论