More about tags & tag definitions

Note: Please read Introduction to SmartTagging before you continue!

Tags help you organize your photo and video content. Before your team uploads project files, you must give the project tag definitions. Read on to learn what tag definitions are, how they behave, and why they’re critical to making the most of Smartvid.io.


What are tag definitions?

Tag definitions do not consist of actually “defining” anything; they are simply saved words or phrases, such as ‘crane’ or ‘second floor,’  that tell our SmartTag engine what to search for in your photo and video content.  SmartTag is trained to recognize essentially any words in speech, as well as thousands of visual object categories, so tag definitions are used to constrain its recognition only to things that are most useful to your team. Otherwise, imagine if a video was automatically tagged with every single word of its accompanying audio (think of a ‘tag transcript’), or a picture tagged with every single color, shape, or object it contained!

When SmartTag looks at project files, it only looks for instances of tags that you have defined. For example, say you upload a video file where the word “crane” is said three times in the accompanying audio. If you create a tag definition for the word ‘crane’, SmartTag will place three instances of the ‘crane’ tag on the video at the timestamps where it is said. But if you haven’t defined ‘crane’ as a tag, SmartTag will notbe listening it, and it won’t register hearing it in the video.


What is the tag dictionary?

The collection of a project’s tag definitions is called its tag dictionary. Since each project’s team will have different, specific needs for content search and  categorization, each Smartvid.io project has a separate, individual tag dictionary; in other words, each project has its own specially “trained” copy of the SmartTag engine. This means that tags definitions are not universal across projects -- if ‘steel’ is a defined tag in Project X, SmartTag will not tag instances of ‘steel’ in Project Y’s content, unless you also define ‘steel’ in Project Y’s tag dictionary. (If this sounds tedious, don’t worry - you will learn how to import old tag definitions quickly and easily.)

Creating a tag dictionary for each new project is the first step for leveraging the power of Smartvid.io. Without tag definitions, SmartTag does not know what you are interested in searching your media for. When a new project is created, our system automatically generates a seed dictionary that contains a suggested set of popular tag definitions for you to start with; this is set of tags is random, and may or may not actually suit your needs. You can and should customize it, or else your uploaded files will be automatically tagged with things that may seem random and irrelevant. So before you add media to a project, customize its tags dictionary to suit your needs. Delete any suggested tags you don’t care to use, and then of course create of your own. Then, get to uploading! (You can always edit the dictionary later on.)


How tags behave

As you create and edit tag definitions, you can customize how and a tag should be applied to project files. There are three different tagging behaviors that can be enabled/disabled for each tag.

Manual tagging - Manual tags are tags added by human beings (instead of by the SmartTag engine). You can add a manual tag to a file in three ways:

Example use: Approval workflows

Say you need to mark files that are approved for use in external marketing or business development efforts. Create a tag definition titled ‘Approved for marketing’ and enable manual tagging. Then, review your files and add the tag manually to approved images and videos.  The marketing team can now search for the ‘Approved for marketing use’ tag to find the content they need, or you can create a link to view all files under the tag using our  ShareSearch feature.

Audio tagging  - Audio tags are placed on video frames based on their accompanying audio. For example, if you enable audio tagging for "bridge" and upload a video where the word "bridge" is spoken 3 times, SmartTag will place a 'bridge' tag at each timestamp where it's said.

Example use: Milestone documentation

Say you need to find all instances of ductwork in the first floor of a building construction site.  Create tag definitions for ‘Ductwork’ and ‘First Floor’. Then, instruct team members to take field videos and narrate what they see. When videos are uploaded, SmartTag will listen to them and tag any instances of ‘Ductwork’ and ‘First Floor’ in the narration. You can then search for either tag, or easily share snippets of videos for milestone check-ins.

Image tagging - Image tags are placed on images based on SmartTag's recognition of objects in their visual content. For example, if you create a tag definition for ‘bridge’ and enable image tagging, SmartTag will use its trained powers to add a ‘bridge’ tag instance to any uploaded picture that contain a bridge. 

Example use: Safety issues 

Say you want to review site imagery to make sure there are no visible safety infractions.  Create a tag definition for  ‘people’ and enable image tagging. Then create tag definitions ‘Safe’ and ‘Unsafe,’ allowing manual tagging for both. Search for ‘people’ tag regularly to find all pictures that have been automatically SmartTagged as having people in them. Then, manually tag these pictures as ‘Safe’ or ‘Unsafe,’ and large search the ‘Unsafe’ tag retrieve and share pictures containing safety issues.

QuickTip: Image tagging is by default only available for photos, but its capacity can be turned on for videos; SmartTag will then treat video frames as images and tag them for their visual as well as audio content. If you’d like to turn on image tagging for videos, please contact support.


Alternate tags

You have the option to add alternate tags to each tag definition you create. SmartTag will register any found instances of alternate tags as instances of the tag they are alternate to. 

Example use: Site locations

It's s common for people to refer to the same location in different ways, such as "Level 1" and "Floor One,” which can hinder tracking a location across narrated videos. To solve for this, create a tag definition for ‘Level 1’ and add ‘Floor One’ as its alternate. Now, if the SmartTagging engine hears ‘Floor One’ in a video, it will automatically add an instance of the ‘Level 1’ tag. The same will happen with any other alternate tags you choose to define within ‘Level 1’, ex. ‘Room 1010’, ‘Room 101’, or ‘Main Lobby’. 


Up Next: Learn how to create your own tag definitions in the Tags project view.

Still need help? Contact Us Contact Us