Mongo使用记录

项目中为了接收来自设备的告警信息,由于不同类别的告警信息结构不固定,所以采用MongoDB进行存储.

建立collection

collection在mongo中类似于关系型数据库的table.

// pom.xml
        
            org.springframework.boot
            spring-boot-starter-data-mongodb
        

指定mongo地址:

spring.data.mongodb.host = 192.168.12.86:30017
spring.data.mongodb.database = vb

设置一个ApplicationRunner让项目启动时检查是否存在该collection:

@Component
public class InitMongoApplicationRunner implements ApplicationRunner {

    @Autowired
    private MongoTemplate mongoTemplate;

    @Override
    public void run(ApplicationArguments args) throws Exception {
        System.out.println("检查mongo...");
        if (!mongoTemplate.collectionExists("testdb")) {
            System.out.println("生成告警表...");
            mongoTemplate.createCollection("testdb");
        }
    }
}

使用终端查看是否创建成功:

[~] mongo 192.168.12.86:30017/vb 
> db.getCollectionNames();

如果使用的mongo shell是2.x,返回会为空.

插入数据

@Service
@Slf4j
public class TestMongoServiceImpl implements TestMongoService {
    @Autowired
    MongoTemplate mongoTemplate;

    @Override
    public void insertAlertMsg(AlertMsgEntity alertMsgEntity) {
        String collectionName = "testdb";
        mongoTemplate.insert(alertMsgEntity, collectionName);
        log.info("插入告警完成");
    }
}

其中AlertMsgEntity的定义为:

// AlertMsgEntity.java
@Data
public class AlertMsgEntity {
    private String method;
    private AlertParamsEntity params;
}
// AlertParamsEntity.java
@Data
public class AlertParamsEntity {
    private String sendTime;
    private String ability;
    private List events;
}

使用postman,往简单的controller里插入数据:

    @PostMapping(value="/eventRcv")
    public BaseResponseVo eventReceive(@RequestBody AlertMsgEntity alertMsgEntity){
        TestMongoService.insertAlertMsg(alertMsgEntity);
        return BaseResponseVo.ok();
    }

插入几条如下格式的json:

{
    "method": "OnEvent",
    "params": {
        "ability": "rule",
        "events": [{
            "data": {
                "dataType": "behavior",
                "recvTime": "2017-04-22T15:39:01+08:00",
                "sendTime": "2017-04-22T15:39:01+08:00",
                "dateTime": "2017-04-22T15:39:01+08:00",
                "ipAddress": "10.10.10.10",
                "portNo": 80,
                "channelID": 1,
                "eventType": "detection",
                "eventDescription": "detection",
                "detection": [{
                    "targetAttrs": "",
                    "imageUrl": "",
                    "direction": 1,
                    "sensitivityLevel": 20,
                    "planeHeight": 30,
                    "detectionTarget": 1,
                    "regionCoordinatesList": [{
                            "positionX": 1,
                            "positionY": 1
                        },
                        {
                            "positionX": 1,
                            "positionY": 1
                        }
                    ]
                }]
            },
            "eventId": "12334567",
            "eventType": 2,
            "happenTime": "2021-08-09T15:17:24.000+08:00",
            "srcIndex": "1",
            "srcName": "",
            "srcType": "",
            "status": 0,
            "timeout": 0
        }],
        "sendTime": "2019-01-02T15:19:59.857+08:00"
    }
}

查询所有记录:

> db.testdb.find();

查询指定eventType的记录:

> db.testdb.find({'params.events.eventType':2});

在此基础上查询日期大于当天的记录:

> db.testdb.find({'params.events.eventType':2, 'params.events.happenTime':{$gt:'2021-08-09'}});

使用distinct去除重复的告警记录:

db.testdb.distinct('params.events.eventId',{'params.events.eventType':2, 'params.events.happenTime':{$gt:'2021-08-09'}});

对应查询今天告警次数的操作的java代码:

    public Integer lineDetectionMsgCount() {
        LocalDate today = LocalDate.now();
        String BEGIN_DAY_TIME_FORMAT = "yyyy-MM-dd 00:00:00";
        String todayStr = today.format(DateTimeFormatter.ofPattern(BEGIN_DAY_TIME_FORMAT));
        Criteria criteria = Criteria.where("params.events.eventType")
            .is(2).and("params.events.happenTime").gte(todayStr);
        Query query = new Query(criteria);
        int count = mongoTemplate.findDistinct(query, "params.events.eventId", "testdb", AlertMsgEntity.class).size();
        return count;
    }

建索引

一种方案是在建表的时候建立索引:

mongoTemplate.getCollection(collectionName).createIndex(
               new Document("happenTime", "hashed"), new IndexOptions().background(false).name("happen_time_idx")
           );

另一种方案是,使用@Document 建表,利用@Indexed建索引,不需要再在ApplicationRunner中进行初始化了:

@Data
@Document(collection = "testdb")
public class AlertMsgDto {

    private String method;
    private String ability;
    private String sendTime;
    private String eventId;
    private String srcIndex;
    private String srcType;
    private String srcName;
    @Indexed(name="event_type_idx")
    private Integer eventType;
    private Integer status;
    private Integer eventLvl;
    private Integer timeout;
    @Indexed(name="happen_time_idx")
    private String happenTime;
    private String srcParentIndex;
    private Object data;
}

使用db.testdb.getIndexes()可以查看索引是否建立成功.