理解Elasticsearch及初步认知框架

• Overview

  Elastic Stack核心产品介绍-Elasticsearch、Logstash和Kibana

  Kibana（一张图片胜过千万行日志）

  ElasticSearch实战－日志监控平台

  GitBook
  The Complete Guide to the ELK Stack

  Elasticsearch的几个标签：

  • 大数据搜索平台。竞品有Splunk、Solr、Lucene等。

  • 数据库

• Notions

• Search engine

  A search engine is an information retrieval system designed to help find information stored on a computer system.

• Apache Lucene

  Apache Lucene is a free and open-source search engine software library, originally written completely in Java by Doug Cutting.

  It is supported by the Apache Software Foundation and is released under the Apache Software License.

• Apache Software Foundation

  The Apache Software Foundation is an American nonprofit corporation to support Apache software projects, including the Apache HTTP Server.

• Multitenancy

  The term “software multitenancy” refers to a software architechture in which a single instance of software runs on a server and servers multiple tenants.

  A tenant is a group of users who share a common access with specific privilegees to the software instance.

• Elasticsearch

  homepage

  official docs

  Elasticsearch is a search engine based on the Lucene library.

  It provides a distributed, multitenant-capable full-text search engine with an HTTP web interface and schema-free JSON documents.

  Elasticsearch is developed in Java.

  Official clients are avaiable in Java, .NET(C#), PHP, Python, Apache Groovy, Ruby and many other languages.

  Accroding to the DB-Engines ranking, Elasticsearch is the most popular enterprise search engine followed by Apach Solr.

• What It Is, How It Works, What It’s Used For

  Elasticsearch allows you to store, search, and analysze huge volumes of data quickly and in near real-time and gice back answers in milliseconds.

  It’s able to achieve fast search responses because instead of searching the text directly, it searches an index.

  At its core, you can think of Elasticseach as a server that can process JSON requests and give you back JSON data.

  Documents are the basic unit of information that can be indexed in Elasticsearch expressed in JSON, which is the global internet data interchanging format. You can think of a document like a row in a relational database, representing a given entity - the thing you’re searching for.

  An index is a collection of documents that have similar characteristics. You can think of the index as being similar to a databse in a relational databse schema.

  A node is a single server that is part of a cluster. An Elasticsearch node can be configured in different ways:

  • Master Node
  • Data Node
  • Client Node

  An Elasticsearch cluster is a group of one or more node instances that are connected together.

  Elasticsearch provides the ability to sudivide the index into multiple pieces called shards. Each shard is in itself a fully-functional and indepenet “index” that can be hosted on any node within a cluster.

• The Elastic Stack (ELK)

  Elasticsearch is the central component of the Elastic Stack, a set of open-source tools for data ingestion, enrichment, storage, analysis, and visualization.

  • Kibana

    Kibana is a data visualization and management tool for Elasticsearch that provides real-time histograms, line graphs, pie charts, and maps…

    2013年加入Elastic公司。

    From github, Kibana is your window into the Elastic Stack.

  • Logstash

    Logstash is used to aggregate and process data and send it to Elasticsearch.

    It is an open-source, server-side data processing pipeline that ingests data from a multitude of sources simultaneously, transforms it, and then sends it to collect.

    Logstash创建于2009年，最初用于做日志的采集和处理，2013年被Elasticsearch收购。

  • Beats

    Beats is a collection of lightweight, single-purpose data shipping agents used to send data from hundreds or thousands of machines and systems to Logstash or Elasticsearch.

  Elasticsearch can be used for Application search, Website search, Enterprise search, Logging and log analytics, Infrastructure metrics and container monitoring, Security analytics, Business analytics.

  Netflix, Ebay, Walmart all use the Elasticsearch.

• 国内使用案例介绍

  《Elasticsearch 在业界的大量应用案例》：滴滴、携程、今日头条、饿了么、京东到家

  《ElasticSearch实用化订单搜索方案》