README
Blobs Microservice
This is blob blobs microservice from Pip.Services library. It stores large binary blobs, manages references to them from other entities and serves stored content to users. Most often binary blobs are used to store images and document attachments.
The microservice currently supports the following deployment options:
- Deployment platforms: Standalone Process, Seneca
- External APIs: HTTP/REST, Seneca
- Persistence: Memory, Flat Files, MongoDB, AWS S3
This microservice has no dependencies on other microservices.
- Download Links
- Development Guide
- Configuration Guide
- Deployment Guide
- Client SDKs
- Communication Protocols
Contract
Logical contract of the microservice is presented below. For physical implementation (HTTP/REST, Thrift, Seneca, Lambda, etc.), please, refer to documentation of the specific protocol.
class BlobInfoV1 {
/* Identification */
public id: string;
public group: string;
public name: string;
/* Content */
public size: number;
public content_type: string;
public create_time: Date;
public expire_time: Date;
public completed: boolean;
}
interface IBlobsV1 {
getBlobsByFilter(correlationId: string, filter: FilterParams, paging: PagingParams,
callback: (err: any, page: DataPage<BlobInfoV1>) => void): void;
getBlobsByIds(correlationId: string, blobIds: string[],
callback: (err: any, blobs: BlobInfoV1[]) => void): void;
getBlobById(correlationId: string, blobId: string,
callback: (err: any, blob: BlobInfoV1) => void): void;
getBlobUri(correlationId: string, blobId: string,
callback: (err: any, uri: string) => void): void;
beginBlobWrite(correlationId: string, blob: BlobInfoV1,
callback: (err: any, token: string) => void): void;
writeBlobChunk(correlationId: string, token: string, chunk: string,
callback: (err: any, token: string) => void): void;
endBlobWrite(correlationId: string, token: string, chunk: string,
callback?: (err: any, blob: BlobInfoV1) => void): void;
abortBlobWrite(correlationId: string, token: string,
callback?: (err: any) => void): void;
beginBlobRead(correlationId: string, blobId: string,
callback: (err: any, blob: BlobInfoV1) => void): void;
readBlobChunk(correlationId: string, blobId: string, skip: number, take: number,
callback: (err: any, chunk: string) => void): void;
endBlobRead(correlationId: string, blobId: string,
callback?: (err: any) => void): void;
updateBlobInfo(correlationId: string, blob: BlobInfoV1,
callback: (err: any, item: BlobInfoV1) => void): void;
markBlobsCompleted(correlationId: string, blobIds: string[],
callback: (err: any) => void): void;
deleteBlobById(correlationId: string, blobId: string,
callback?: (err: any, item: BlobInfoV1) => void): void;
deleteBlobsByIds(correlationId: string, blobIds: string[],
callback?: (err: any) => void): void;
}
Download
Right now the only way to get the microservice is to check it out directly from github repository
git clone git@github.com:pip-services-infrastructure/pip-services-blobs-node.git
Pip.Service team is working to implement packaging and make stable releases available for your as zip downloadable archieves.
Run
Add config.yaml file to the root of the microservice folder and set configuration parameters. As the starting point you can use example configuration from config.example.yaml file.
Example of microservice configuration
{
---
- descriptor: "pip-services-commons:logger:console:default:1.0"
level: "trace"
- descriptor: "pip-services-blobs:persistence:file:default:1.0"
path: "./data/blobs"
- descriptor: "pip-services-blobs:controller:default:default:1.0"
- descriptor: "pip-services-blobs:service:http:default:1.0"
connection:
protocol: "http"
host: "0.0.0.0"
port: 8080
}
For more information on the microservice configuration see Configuration Guide.
Start the microservice using the command:
node run
Use
The easiest way to work with the microservice is to use client SDK. The complete list of available client SDKs for different languages is listed in the Quick Links
If you use Node.js then you should add dependency to the client SDK into package.json file of your project
{
...
"dependencies": {
....
"pip-clients-blobs-node": "^1.0.*",
...
}
}
Inside your code get the reference to the client SDK
var sdk = new require('pip-clients-blobs-node');
Define client configuration parameters that match configuration of the microservice external API
// Client configuration
var config = {
connection: {
protocol: 'http',
host: 'localhost',
port: 8080
}
};
Instantiate the client and open connection to the microservice
// Create the client instance
var client = sdk.BlobsRestClient(config);
// Connect to the microservice
client.open(null, function(err) {
if (err) {
console.error('Connection to the microservice failed');
console.error(err);
return;
}
// Work with the microservice
...
});
Now the client is ready to perform operations
// Create a new picture
var blob = {
group: "pictures",
name: "google_search.jpg"
};
client.createBlobFromUrl(
null,
blob,
"https://www.google.com/logos/doodles/2016/doodle-4-google-2016-us-winner-5664555055185920-hp.jpg",
function (err, blob) {
...
}
);
// Start reading blobs in chunks
client.beginBlobRead(
null,
blob_id,
function(err, size) {
...
client.readBlobChunk(
null, blob_id, 0, size,
function (err, chunk) {
...
}
);
}
);
Acknowledgements
This microservice was created and currently maintained by Sergey Seroukhov.