8. Quick Start Guide

This Quick Start Guide serves as a fast, hands-on introduction to L7|ESP and will walk you through performing common L7|ESP activities. Specifically, this Quick Start Guide will teach you how to:

  • Navigate L7|ESP's user-friendly user interface (UI).

  • Create a simple Protocol that tracks values associated with Entities.

  • Create a simple Pipeline that generates a Report after each Entity is processed.

  • Create a Workflow that allows the Protocol and Pipeline to be used together to process Entities.

  • Create a Project for managing Experiments.

  • Register Entities and then use the registered Entities in an Experiment based on the Workflow.

  • Update the Workflow to learn about versioning, data linking, and L7|ESP Expressions.

8.1. Login

Open the URL provided by your Admin in any web browser. Log in using the credentials provided by your Admin.

../_images/log-in.png

Hint

If you are a new user and this is your first time logging in, it is recommended that you immediately reset your original password for security purposes.

8.2. Create Standard Protocol

In this section you will create a Standard Protocol to collect 260:280 ratios for nucleic acid Entities. This Standard Protocol will later be used when creating a Workflow.

  1. Click the L7|Master app. Click Protocols from the Processes menu to access the Protocols page.

../_images/protocols1.png
  1. Click + New Protocol.

../_images/add-new-protocol1.png
  1. Enter "260:280 Quantification" in the Name field. Select No under the Use in manufacturing and select Standard Protocol as the Protocol Type.

../_images/name-select-protocol-type0123.png
  1. Click + Add Field.

  2. Enter "Type" in the Display Name field.

  3. Select Picklist as the Type. Expand the Parameters section and enter "DNA" in the Enter option 0 field. Enter "RNA" in the Enter option 1 field.

../_images/enter-options-first-column.png
  1. Click + Add Field. (Observe that the Type field is saved and present in the Fields view and a new Field Details panel opens).

../_images/add-column-897.png
  1. Enter "260:280 Ratio" in the Display Name field. Select Numbers only allowed as the Type.

../_images/enter-options-second-column.png
  1. Click Save.

You now have a simple spreadsheet with three fields for data entry: a field to select the nucleic acid Entity type (i.e., DNA or RNA), a field to enter the measured ratio, and a default Complete field.

../_images/standard-protocol-example.png

8.3. Create Task for Pipeline

In this section you will create a Task that will use a bash shell script to perform a purity test to determine if the measured ratio is within the accepted range for the Entity material (i.e., DNA or RNA). This Task will later be used when creating a Pipeline.

Hint

It is recommended that programmers create Tasks for Pipelines.

  1. From the Analysis app, click the Tasks tab. Click + New Task.

  2. Enter "260-280 Purity Test" in the Name field.

  3. Copy the purity test code below (from line 1 to line 22). Be aware the bc command line program referenced in this pipeline is not always available. If the command fails, try installing the bc program.

 1# Simple Task that determines if the 260:280 ratio is in the proper purity range 
 2
 3RNA_MIN=1.8
 4RNA_MAX=2.1
 5
 6DNA_MIN=1.7
 7DNA_MAX=2.0
 8
 9TYPE={{ material }}
10RATIO={{ ratio }}
11
12if [ $TYPE = "RNA" ]; then
13    PASS=`echo  "$RNA_MIN <= $RATIO  && $RATIO <= $RNA_MAX" | bc`;
14elif [ $TYPE = 'DNA' ]; then
15    PASS=`echo  "$DNA_MIN <= $RATIO  && $RATIO <= $DNA_MAX" | bc`;
16fi
17
18if [[ $PASS = 1 ]]; then
19  echo "<b>Your sample <font color='green'>Passed</font> and contains pure $TYPE</b>" >> result.html
20else
21  echo "<b>Your sample <font color='red'>Failed</font> and is NOT pure $TYPE</b>" >> result.html
22fi

Note

Observe that {{ material }} and {{ ratio }} have double curly braces around them. {{ ... }} denotes an L7|ESP Expression. L7|ESP Expressions are based on the Python programming language and can be any single-line Python statement (with some security restrictions). Expressions are evaluated before a Task is executed, allowing you to supply parameters to Tasks (in this case, material and ratio) and to perform simple computations.

For more information on expressions, refer to L7|ESP Expression Language.

  1. Paste the purity test code as shown below.

../_images/new-task-name.png
  1. Click Save.

8.4. Create Registered File

In this section you will create a Registered File, which will track the result of the purity test.

  1. Register the result.html file generated by the Task by clicking + Add below Output Files.

  2. Enter "Result Report" in the File Name field. Enter html in the File Type field. Enter {{ 'result.html' }} in the Expression field. Click Save.

../_images/tasklibrary-registeroutputfile.png
  1. Click Save to save the updated Task.

Every time the Task is executed, the result.html file generated in the Task directory is registered with L7|ESP and then added to the Task's provenance (and, by extension, the Pipeline's provenance and the Entity's provenance). To learn more about L7|ESP provenance system, refer to Provenance System.

The final 260:280 Purity Test Task looks like this:

../_images/tasklibrary-final.png

Note

Files are typically registered by Tasks when Pipelines are executed, but you can also register files using the command line tools. To register a file from the command line, use the l7 command:

$ /path/to/l7 file register /path/to/file

8.5. Create Pipeline

In this section you will create a Pipeline, which will use the Task you created earlier, to generate quality control reports for DNA and RNA purification. This Pipeline will later be used to create a Pipeline Protocol.

  1. From the Analysis app, click the Pipelines tab. Click + New Pipeline.

../_images/new-pipeline.png
  1. Enter "260-280 Purity Test" in the Name field. Click the blank Task box.

../_images/taskbox.png
  1. Start entering "260" and select "260-280 Purity Test" from the auto-complete list.

../_images/pipelinebuilder-taskbox.png
  1. Click Save.

8.5.1. Test Pipeline

In this section you will test the new Pipeline you created.

  1. Click Run.

../_images/pipelinebuilder-runn.png
  1. Enter "DNA" for the material parameter. Enter "1.9" for the ratio parameter. Click Run.

../_images/parameters-run-17.png
  1. Click the Monitor tab. Click the "260:280 Purity Test" row for the DNA/1.9 run. The Pipeline Inspector on the right displays basic information about the executed Pipeline.

../_images/pipelinemonitor-inspector.png

Navigate through the results as follows:

  • Click the vertical ellipsis and then click View Details. This will redirect you to a page that looks similar to the Pipeline Builder. The key difference is that the Run Details page displays actual details from the run. Click the Task (the "260-280 Purity Test" box) to view run-time details, including associated Task Files. The Task Inspector on the right has links to the complete Task Script (as executed on the server); stderr and stdout for the script; and also a link to the Registered File, Result Report.

../_images/view-run-details-INSERT.png
  • Click Result Report... to view the contents of the Registered File. You have now successfully tested the Pipeline.

../_images/result-report.png

8.6. Create Pipeline Report

The Pipeline and Registered File demonstrate how to create a simple Pipeline and make the results available in L7|ESP; however, locating and viewing Files generated by Pipelines through Run Details can be cumbersome, especially if the Pipeline generates many Files not used for Reports (e.g., such as those tracked for provenance purposes). Additionally, you may want to display data from multiple Registered Files at once. L7|ESP’s Report Builder provides such a service.

In this section you will use the Registered File to create a Report for the Pipeline.

  1. From the Analysis app, click Pipelines. Click Edit on the 260:280 Purity Test row.

../_images/pipeline-edit.png
  1. Click the Reports tab to access the Report Builder.

  2. From the Report Elements list, drag "HTML file" to the canvas area and drop it on the Drag and drop a new report element here field.

../_images/drag-file-details.png
  1. From the Registered Files list, drag "Result Report (Step 1: 260-280)" to the canvas area and drop it on the Drag and drop a registered file here field.

../_images/drag-result-repor.png
  1. Click Save.

../_images/rawfile-resultreport.png

8.6.1. Test Updated Pipeline

In this section you will test the updated Pipeline in order to see the new Report.

  1. From the Analysis app, click the Pipelines tab. Click Run on the 260:280 Purity Test row.

../_images/parameters-101.png
  1. Enter "RNA" for the material parameter. Enter "1.5" for the ratio parameter. Click Run.

../_images/parameters-78.png
  1. Click the Monitor tab. Click the new "260:280 Purity Test" row for the RNA/1.5 run. Click View from the Pipeline Inspector on the right to view the RNA Report. The Report shows a failed RNA Purity test.

../_images/pipelinereport-inspector-view.png

Important

From the Monitor tab, the first run (i.e., DNA/1.9) of the 260:280 Purity Test Pipeline does not have a Report associated with it, only the Registered Files. This absence is due to how L7|ESP versions Pipelines. When a Pipeline is run, the Pipeline Instance uses the current version of the Pipeline. If the Pipeline is updated later, only new Instances of the Pipeline will incorporate those updates. Refer to Versioning System for more information.

8.7. Create Pipeline Protocol

In this section you will create a Pipeline Protocol using the Pipeline you previously created in order to feed Entity data into the L7|ESP Pipeline system for computational analysis.

  1. Open the L7|Master app. Click Protocols from the Processes menu to access the Protocols page.

../_images/protocols1.png
  1. Click + New Protocol.

../_images/add-new-protocol1.png
  1. Enter "260:280 Report" in the Display Name field. Select No under Use in manufacturing. Select Pipeline Protocol as the Protocol Type. Select 260:280 Purity Test as the Pipeline.

Observe that two new fields appear in the Field View: material and ratio. These two new fields are for data entry, which will later be performed by filling out a Worksheet in the LIMS app.

../_images/name-select-protocol-type.png
  1. Click anywhere in the material field. The material field will be highlighted in blue. In the Field Details panel, select Picklist as the Type. Expand the Parameters section and enter "DNA" in the Enter option 0 field. Enter "RNA" in the Enter option 1 field.

../_images/material-column-details.png
  1. Click anywhere in the ratio field. Now the ratio field will be highlighted in blue. In the Field Details panel, select Numbers only allowed as the Type.

../_images/edit-column-numbers-only.png
  1. Click Save.

You have now created a Standard Protocol and Pipeline Protocol, which will be used to create a Workflow.

8.8. Create Workflow

In this section you will create a simple quality control Workflow that determines the purity of a DNA or RNA Entity using the 260:280 spectrophotometric ratio. The image below shows that this Workflow will have two Protocols: a Standard Protocol to collect the 260:280 ratio and a Pipeline Protocol to generate a quality control Report.

../_images/workflow-example-1.png

Note

Workflow building is usually done by L7 Informatics during a customer's preliminary setup period; however, after following this section you will have the knowledge to create Workflows on your own, at any time.

  1. Open the L7|Master app. Click Workflows from the Processes menu.

../_images/workflows1.png
  1. Click + New Workflow.

../_images/add-new-workflow1.png
  1. Enter "260:280 Purity Assay" in the Display Name field. Select No under Use in manufacturing.Click and drag the 260:280 Quantification (from the Protocol Library panel) and drop in between the default Submitted and Completed boxes.

../_images/drag-drop-first-protocol.png

Note

The Submitted and Completed boxes are not Protocols or data entry fields - they are visual aids to display the status and quantity of an Entity Set as the individual Entities move through an Experiment. Specifically, the Submitted box displays the quantity of Entities submitted to a Workflow and the Completed box displays the quantity of Entities that have advanced through the entire Workflow.

  1. Click and drag the 260:280 Report (from the Protocol Library panel) and drop in between the 260:280 Quantification Protocol and the default Completed box.

../_images/drag-drop-second-protocol.png
  1. Click Save.

8.9. Create Project

In this section, you will create a Project. A Project is a collection of Experiments, grouped together for organizational purposes. You must create a Project before creating an Experiment.

  1. Open the Projects app. Click + New Project.

  2. Enter the Project name as "Quick Start."

  3. Click Save.

../_images/quick-start-save.png

8.10. Create Experiment

In this section you will create an Experiment, add the Experiment to the Project you previously created, and add/submit Entities to the Experiment.

  1. On the row of the Quick Start Project you just created, click + Experiment.

../_images/create-an-experiment-1.png
  1. Verify that Workflow is selected. Select 260:280 Purity Assay from the Workflow drop-down. Enter "Hello Quick Start" as the Name. Click Next.

../_images/define-experiment.png
  1. Click Add New Entities. Select Generic sample from the Entity Type drop-down. Enter "4" in the Number of Entities field. Verify that ESP SEQUENCE is selected from the Entity ID Sequence drop-down. Click Next.

../_images/register-new-samples.png

Note

Entity ID Sequence is used to generate Entity names automatically as Entities are added.

  1. Check the box to the left of Entity ID to select all 4 Entities. Click Save and Submit.

../_images/save-and-submit-samples.png
  1. Click Submit Entities in the Submit Confirmation dialog.

The Experiment (with four Entities) has been submitted to the LIMS app.

8.11. Create Worksheet and Add Entities

In this section you will create a Worksheet and add the Entities from the Experiment you previously created to the Worksheet. This Worksheet will later be used for data entry.

  1. Open the LIMS app. Click the icon (shown below) that is located to the right of Hello Quick Start (4). This will open the Add New Worksheet dialog.

../_images/lims-newsheet-plusicon.png
  1. Observe that the Name and Workflow fields are already populated. Update the Name to "Quick Start Sheet 1". Confirm that "260:280 Purity Assay" is selected as the Workflow. Click Add Worksheet.

../_images/newsheet-parameters.png
  1. To view the Worksheet, click the Quick Start Sheet 1 link.

../_images/click-worksheet.png ../_images/lims-newworksheet-2.png

8.12. Process Entities and Perform Data Entry

In this section you will practice processing Entities by performing data entry in the Worksheet you just created.

  1. In the Type column, select "DNA," "DNA," "RNA," and "RNA" from the drop-down list as shown below.

  2. In the 260:280 Ratio column, enter the values "1.7," "1.8," "1.9," and "2.0."

  3. Select the "Complete" checkbox for each Entity.

  4. Click Save.

../_images/filled-worksheet-1.png

Hint

Be sure to Save Worksheets as they are completed. L7|ESP stores the history of all Worksheet data, but clicking Save is necessary to ensure data goes into the system.

Important

To understand how the Entities are moving through the Experiment, open a new browser window and open the Projects app. Click the Experiments tab. Click the Hello Quick Start link under the Quick Start Project.

../_images/samples-have-moved.png

The blue 4 above 260:280 Report indicates that the 4 Entities you completed in the 260:280 Quantification Protocol have advanced to the 260:280 Report Protocol.

../_images/samples-have-moved-2.png

The white 1 in a blue box indicates 1 Entity set. The red 0 indicates that 0 Entities failed the 260:280 Quantification Protocol. The green 4 indicates that 4 Entities passed the 260:280 Quantification Protocol.

../_images/samples-have-moved-3.png

Return to the browser window with the LIMS app.

  1. Click Next to enter information for the next Protocol.

../_images/complete-next-worksheet.png
  1. In the Material column, select "DNA," "DNA," "RNA," and "RNA" from the drop-down list.

  2. In the Ratio column, enter "1.7," "1.8," "1.9," and "2.0."

  3. Click Save.

../_images/filled-worksheet-3.png
  1. For the first Entity, click Start Pipeline to run the Pipeline that generates the Report. Click Run in the Run Pipeline verification dialog.

../_images/run-pipeline-31.png
  1. Entities can run simultaneously so click Start Pipeline and then Run in the Run Pipeline verification dialog for each of the remaining Entities. All Complete checkboxes will be checked and the Start column will say Done once the Pipelines are finished running.

../_images/run-pipeline-4.png

Important

To monitor Entities as they move through an Experiment, open the Projects app. Click View Details on the the Quick Start Project. Observe that the 4 Entities have advanced to the Completed stage.

../_images/view-status.png

Click on the Protocol box for the 260:280 Report. Observe that the Reports are directly accessible from the Inspector. The Reports are also accessible from the Entities page.

../_images/click-260-280-report-protocol.png

8.14. Test Updated Workflow

To test your new L7|ESP knowledge and skills (as well as the Data Links), perform the steps below to test the updated Workflow.

  1. Create a new Experiment under the Quick Start Project as follows:

  • Select the 260:280 Purity Assay Workflow.

  • Name the Experiment "Linked Quick Start."

  • When adding Entities, choose the Use Existing Entities option and check 3 random Entities.

  • Submit the 3 Entities.

  1. Create a Worksheet for the Experiment named "Quick Start Sheet 2".

  2. "Process" the 3 Entities and perform data entry as follows:

  • Open the Quick Start Sheet 2 Worksheet.

  • Complete the 260:280 Quantification Protocol by filling out the Type column and the 260:280 Ratio Column.

  • Complete the 3 Entities to advance them to the next Protocol (i.e., 260:280 Report Protocol). Observe that the material and ratio columns are prepopulated with the data from the 260:280 Quantification Protocol. This demonstrates that the data links are working.

  • Run the 3 Pipelines to complete the Experiment.

  • Click Save.

  • View the results of the Experiment.