Michelle Eichelberger: Good morning, everyone. It's 11 o'clock, so why don't we go ahead and get started with this week's ERS discovery session and today we're going to talk about setting up discovery important profiles.
Michelle Eichelberger: So today we're going to talk about how to configure discovery important profiles, particularly for live guides and D space and look at what comes in. Once you set up the profile.
Michelle Eichelberger: We're going to talk a little bit about what kind of data can be harvested and what kind of normalization, you might want to do with that data.
Michelle Eichelberger: What we're not going to cover is setting up import profiles for acquisitions or traditional resources like science director ebook CENTRAL, THIS IS JUST discovery content.
Michelle Eichelberger: So why would you want to do this if you set up an import profile you can keep your content up to date.
Michelle Eichelberger: This would be content out in the space or live guides you can set a harvest schedule so it just regularly pulls in new content that you have added in those systems.
Michelle Eichelberger: You might not have Mark records for this content or have it in any other format that's easily loaded into Alma if you did have Mark records, like if you had an E book set or something like that.
Michelle Eichelberger: It would probably work better to just load that content directly into Alma, it's easier to manage. That way, you wouldn't need to set up a discovery profile.
Michelle Eichelberger: So, but the discovery profile does help us to bring in more sources and it makes it easier for patrons to find that material because it'll be all included in your single search in primo
Michelle Eichelberger: So what kinds of things can you import. I just put some links to some ex sleepers documentation about this.
Michelle Eichelberger: There's really good information out there and I didn't want to get into it too deeply because we have a lot to cover today, but these links are here and the slides will be posted for this session.
Michelle Eichelberger: Setting up these imports can take a little trial and error to set up and we'll talk about some of the problems you might run into
Michelle Eichelberger: One of the challenges I've found that it's really hard to add a proxy when you're bringing in content so
Michelle Eichelberger: We're going to use the space as an example today and it works great if the content is open. If you don't have to log in to get to it. But for something like the Sunni press collection of records from 2003 to 2006 which requires a proxy that can be a little more challenging.
Michelle Eichelberger: You might need to set up norm rules and linking syntax and that's not totally intuitive, we will be talking about that.
Michelle Eichelberger: And as I mentioned with the discovery import profile the records don't actually get imported into Alma is like a
Michelle Eichelberger: Portfolio. So if you're trying to do troubleshooting or deal with those records, it can be challenging because you can't just do a title search and Alma and find that content in there.
Michelle Eichelberger: But there are good things about this. So I don't want to be a big downer at the beginning of the presentation.
Michelle Eichelberger: So Christie Lee Heidi web and Rebecca now setup excellent FAQs about discovery import profiles, there's two different ones here. There's the lip guides one and then the D space metadata and what we're going to do today is not go, word for word through these, but
Michelle Eichelberger: We are going to use information from these guides so thanks to all of them for putting that together.
Michelle Eichelberger: So what we're going to work on today and show you just a path through the setup is we're going to look at SUNY Fredonia masters theses
Michelle Eichelberger: So these live out here in the Sunni digital repository. There's a lot of great information out there and lots of campuses have set up a way to publish their theses or dissertations.
Michelle Eichelberger: Or other kinds of information out there. They are open, meaning that you don't have to set up your proxy to get to them.
Michelle Eichelberger: So that's a good thing. And that's why we're using this collection today. So in this particular case there are 210 titles in the collection.
Michelle Eichelberger: The dates range from 2012 to the present, and they are hosted in the space. And this is the collection information which is really important to keep track of.
Michelle Eichelberger: So you can set up the import profile and a couple of different places you it kind of is sending you to the same eventual spot, but you can either go through
Michelle Eichelberger: Your resources tab and then manage import profiles, or you can also get to it through discovery. Same kind of thing. So it takes you to the same spot, but there are multiple ways to get to it.
Michelle Eichelberger: Once you get to that site the Manage import profiles, which you want to do is add a new profile and you want to set it up as a discovery profile.
Michelle Eichelberger: Then once you get in there. Again, we're doing the space so
Michelle Eichelberger: In this case, we're just going to call it D spaces, the profile name. You can use whatever name you want. You can also use whatever name you want here for the the data source label.
Michelle Eichelberger: When you're importing from D space from the Sunni dissipate. Here's all of the other information that you need to make sure you have entered
Michelle Eichelberger: The import pro protocol is OSI physical source format is XML and the source format is Dublin Core and you do want to make sure that all of those are set correctly because if you
Michelle Eichelberger: Set them with different settings. You could have problems with it.
Michelle Eichelberger: To start with, I would recommend making your schedule or inactive, the scheduler is what tells it to harvest. You know, every week, every Wednesday. Every whatever. But when you're first setting it up, you don't really need to have that set
Michelle Eichelberger: For the Sunni content. Specifically, this is the base URL that you're going to use and I
Michelle Eichelberger: This is an image. So it's not gonna be easy to copy from there. So I did make sure to put it on the slide as well. So if you want to do this kind of a setup you can come in here and just grab this URL.
Michelle Eichelberger: And then what you want to do once you have that in there is you do connect and edit and once you do that, that's going to let you pick the set that you want.
Michelle Eichelberger: Because all of those different you know Fredonia or New Paltz or whatever, all of the sets are included underneath this request URL.
Michelle Eichelberger: Once you do that connect and edit the screen will change and give you more fields and more information. So you want to make sure that the metadata prefixes OSI underscore DC
Michelle Eichelberger: This sets. This is where you pick the set that you want.
Michelle Eichelberger: So there's a ton of stuff in there that's hosted out in the Sunni D space. So you would click on the little down arrow and then pick out the one that you want. You can search by number. So if you had that number that I mentioned earlier.
Michelle Eichelberger: From the actual D space site you can look it up that way you can search by title you have several options. And then once you've got this set how you want it to look. Then you want to open a test page. And that's just to make sure that the import is going to work.
Michelle Eichelberger: So in this case, we were looking for. I have to move the chat window we were looking for the 20 9061 collection.
Michelle Eichelberger: So I could start searching 29. Oh, and then it pulls up these results. So this is the one that I want.
Michelle Eichelberger: And as I mentioned, there's a lot in there and it can be a little confusing if you don't have that number because in this case this collection is just called masters theses, it's not obvious that it's the phenomena master's thesis. So this is useful information to keep track of.
Michelle Eichelberger: Right. So the test page. So once you click on Open test page, you'll get this pop up box and it'll ask you if you want to test the first record.
Michelle Eichelberger: The, you know, a random record ID, you probably don't want to use the ID, because you may not know what the ideas I generally do a random record so I can test test different ones. And so you just click on that little circle and click on test.
Michelle Eichelberger: You wanted to say that it passed obviously passing is good.
Michelle Eichelberger: And what it does is it gives you the source record that's coming in from D space and then what it turns into once it's come into your system, which is the DC record.
Michelle Eichelberger: There are these little expand or things for each of these boxes and you can pull it out and see all of the code in there.
Michelle Eichelberger: You can also copy the code. If you wanted to paste it into something, and look at it in a different way, you'll get a little crossed out circle when you try to do that. But you really can copy it. It's totally misleading.
Michelle Eichelberger: So what you want to do is looking at the source code there identify your tags and I copied some of it down here. So from the space you're getting multiple DC identifiers
Michelle Eichelberger: And what that is is is the URL for how to get to the content, but you can see there's two different ones. There's this one and then there's also this one.
Michelle Eichelberger: And they have different URLs. So we need to keep that in mind. We're going to talk about what to do about that later. Because if we just left this as is the system wouldn't know which link to use. So you're gonna have to tell it which one to pull out to us for you're linking to the content.
Michelle Eichelberger: Okay, so there is an option to set up your normalization. When you're going through with your initial setup, but we're going to talk about that later. Because I want you to see what happens if you don't do any normalization.
Michelle Eichelberger: The, the stuff will still get into primo it'll still be functional. It just won't look as pretty as you might want it to look. But
Michelle Eichelberger: You know when you're initially setting this up. You don't really have to do anything with that, to start with. So I mentioned that there were multiple DC identifier fields. This is this delivery tab. This is where you manage that.
Michelle Eichelberger: So it tells primo which field to use to create the link to your content that's the stuff that's going to show in the view online and how to handle it.
Michelle Eichelberger: One thing that's nice is if you set up your initial profile and you don't like how it works. You don't have to re export to get the links to update
Michelle Eichelberger: You can just go in and edit the delivery and hit save and it'll change it automatically for you. So that's kind of a cool thing that I didn't know when I was first working with this.
Michelle Eichelberger: Content. So because we have more than one DC identifier in the content, we have to use the linking parameter. And so the template is
Michelle Eichelberger: Dollar sign dollar sign linking parameter one. So that's what you would put up here in template this link label that's what's going to show in primo. So if you wanted to call it you know link to Fredonia
Michelle Eichelberger: Masters theses, you could call it that you could call the link to the space, you could just call it the space you can call it whatever you want.
Michelle Eichelberger: This you leave as template and then. So we've referenced linking parameter up here, down here, lower in the page, you have to tell the system what that linking parameter is so you're going to edit that field.
Michelle Eichelberger: And we're going to add some code to that parameter
Michelle Eichelberger: This is super confusing and also somewhat irritating. Because look, there's nothing in here, but there is actually something in here. So it looks like there's nothing in there. It's invisible. I don't know why, but that is how it works. So
Michelle Eichelberger: You have to click on the little three dots in the middle to look up your source tag. And once you do that, you'll get this list of all of the different source tags that you could pick out to use for your linking
Michelle Eichelberger: And the one you want to pick is this. There's several DC identifiers, but you want the one that has nothing in the encoding schema and just plain old vanilla identifier. So you're going to select that one.
Michelle Eichelberger: So again, it looks like you selected nothing but you really did. And you can tell that it's selected because actually, let's go back to let me go back. You can tell because the fields below are going to show that you did select that guy.
Michelle Eichelberger: So, and then what you're going to do is a matching string using a regular expression and this is the code that tells it that it wants to look for the HDL handle DC identifier and not the one that starts with oh AI.
Michelle Eichelberger: And you can see there's like this weird stuff in here. That's what it needs to work with this string. So I know that you know
Michelle Eichelberger: These should be slashes just singles lashes, but it has to be coated this way to work, make it work correctly and I am taking no credit at all for figuring this out.
Michelle Eichelberger: I think this came from the space documentation and if it didn't have Christie figured it out. This is great because this is what you have to get in there to make it work. It's super sensitive. So if you have an extra space or if you have
Michelle Eichelberger: You know, a semi colon instead of a colon, it will not work. So you're gonna want to copy this. Exactly. Whoops.
Michelle Eichelberger: And I did again put this on the slide, so that you can copy it, because this is just an image and then you're going to do. No, no. Normalization because you don't need to do any normalization on that particular link and then you just click Save.
Michelle Eichelberger: And then you're going to run the import profile. So once you've hit save, you're going to see a list of all of the import profiles that you've set up. You go to the three dots and hit run
Michelle Eichelberger: And then what you'll see right off the bat is, you know, here's the box, nothing's happening. And then you just keep hitting refresh and it'll tell you when it's done.
Michelle Eichelberger: And then once it's done. And you'll see it'll be this great bright neon green and then you can click on the three dots again and go to the report, and that'll tell you what happened. This is what you want to see you want to see that it completed successfully that is always a good sign.
Michelle Eichelberger: Once you go into the report. It should tell you how many records are processed.
Michelle Eichelberger: And then if you scroll down a little bit, you can actually get to those records to see what came in. So this is interesting. I mentioned earlier that the fruit Anya master's thesis had 210
Michelle Eichelberger: Records, but only 198 of them came in. So we are 12 record short and this could be there might be a metadata problem in the D space records. So you might have to do some playing around to see why those 12 didn't come in and
Michelle Eichelberger: You know, if it's really a big problem. You may need to work with all this to get the metadata updated.
Michelle Eichelberger: And try and get that working correctly, but this is a really handy thing. So let's look at what you get if you scroll down a little bit on this page.
Michelle Eichelberger: You'll get your report table so new records added, you can click the three dots and it'll actually give you the records.
Michelle Eichelberger: So this is really nice. And this is a way you can get a list of all the MMS ideas that came in, you know, and here's the link to it in the space.
Michelle Eichelberger: But the problem with this is, as I mentioned, they're not really an Alma, you can't like look this up as a record in Alma and see the bib and all of that stuff because that's not really how this works. This is just kind of
Michelle Eichelberger: sucking it in from the space and then it lives in this mysterious place.
So that can be challenging.
Michelle Eichelberger: So then to test this to make sure that it worked correctly. What you would do is you would go out to that D space collection.
Michelle Eichelberger: And pick a title of something that you know that should be coming up in primo now and this should happen right after you run the job, which is kind of a nice thing. You don't have to wait for publishing. You don't have to wait for any of that.
Michelle Eichelberger: And the default for the way this works is that it gets added to your everything search. So it should just be in there right away.
Michelle Eichelberger: So if you don't do any normalization your content could be coming in with a resource type of other it's got this kind of generic page icon here. You may not like that. So if you don't want it to look this way. This is where the normalization comes in.
Michelle Eichelberger: You can also mess with the dates. You can see that there's no date showing here so you can do normal rules to make the date show up. But as far as like bulk force it into your primo. You don't need to do anything with normalization.
Michelle Eichelberger: So again, here's a little bit more information about the testing. What you want to do is go in and make sure that your link works and you want to make sure that the bid content looks how you want it to look.
Michelle Eichelberger: Again, you can make norm rules to make this source look different dates, etc. And this I mentioned earlier, you can change what this says. In this case I had just left it on link to resource. So that's what showing us the name of the link
Michelle Eichelberger: So let's talk a little bit about normalization rules. These are used a lot in cataloging
Michelle Eichelberger: And not so much usually for discovery. But in this case, you might want to set some up. And as I mentioned, these live guides that I had linked to above have really awesome information about how to set up norm rules because they can be real fiddly so
Michelle Eichelberger: This I think is from Christie's FAQ. What you want to do before you even start making normals is you want to make sure that your placement of new rules is local rather than network because if you put it in the network, it can be challenging to get to it. So you want to test that first
Michelle Eichelberger: And then when you're in the MD editor you want to go down so you know when you first open it you have to scroll down to get to your rules and then
Michelle Eichelberger: This shows you the rules that are in there already. And what you want to do is file and then new and then you want to do a new Dublin Core norm rule.
Michelle Eichelberger: So here's one that you can set up to change the other resource type to book. So what it does is
Michelle Eichelberger: For anything that's in this set that you're applying this to that the true means just do this all the time for everything. There are no criteria like when such as such as is happening, do this. You just wanted to do this thing all the time.
Michelle Eichelberger: And what you're telling it to do is make it book as the discovery resource type
Michelle Eichelberger: And so what you would do is you would create it, you would make sure that it's got a name.
Michelle Eichelberger: And this private versus shared I'm not completely 100% sure about this. I think you wanted to be private. Again, this is pretty fiddly but this is what the live guide says to do so. I'm or the FAQ says to do so let's go with that.
Michelle Eichelberger: So then once you have your rule created, you're going to save it and then you need to go to properties and make sure that it's enabled. Because if it's not enabled. You won't be able to get to it to use it.
Michelle Eichelberger: Then as I mentioned normalization is fiddly. So you create your rule. And you do that in the empty editor.
Michelle Eichelberger: The next thing you have to do is set up a normalization process task to work with your rule and the place you do that is in config and discovery and loading external data sources and normalization process task.
Michelle Eichelberger: What you do is you create a new task and you're going to make it a DC normalization cask, and then you can call it whatever you want. You can use whatever description you want
Michelle Eichelberger: Then you're going to, it's going to ask you what kind of a task you want to do, and you want to be able to get one option which is DC drool normalization.
Michelle Eichelberger: And then what's supposed to happen is, once you get to the next screen you're supposed to be able to click on this little down arrow and it'll show all of the norm rules that you could pick and you pick the one that you just created.
Michelle Eichelberger: I did have some trouble with this out in the Empire sandbox yesterday. And I'm assuming that's probably something that I did wrong, but if you run into problems, don't be surprised.
Michelle Eichelberger: And if you do, I would either post your question on a base camp or submit a Salesforce ticket because again this can be a little fiddly
Michelle Eichelberger: So then once you have your tasks setup, then you can go back and edit your import profile. And in that case, you would go to normalization, and then you would tell it what you want to use to normalize your data and then you would rerun your import
Michelle Eichelberger: If you want to rerun your import. This is another thing that's a little weird about this. What you have to do is you have to reconnect and edit.
Michelle Eichelberger: And you have to put the date back in time, because if you tell it just to rerun again. And there were no records added after the last time you added records.
Michelle Eichelberger: It's not going to have anything to pull in. So you need to change your harvest start date and rule of thumb, what we've been doing when playing with this stuff is you make it 1938 because that's the earliest year that there's any content in the space.
Michelle Eichelberger: So you would just change this to oh 219 1938 and then hit save and then run it and then it should bring your content and again. And now that you have normalization, it should change it.
Michelle Eichelberger: And I don't have a screenshot of how it would change it, but what it would do is in primo instead of just saying other you would now have either thesis or book or whatever. It told you you told it to put on your primo records.
Michelle Eichelberger: So a couple of tips and tricks that I wanted to let you know about is you can duplicate import profiles. If you want to set up a new one, that's very similar to the old one.
Michelle Eichelberger: Which is really handy if you're doing a bunch of you're pulling out a bunch of different collections from the space because it'll keep all of the you know the harvest URL and all of that.
Michelle Eichelberger: But if you do this, just make sure to change the status from inactive to active
Michelle Eichelberger: Because that is easy to miss. And that happened to me yesterday and I was like, why does this keep failing. Well, it's because I forgot to change it from inactive active when it makes a copy it automatically makes it inactive.
Michelle Eichelberger: So if your collection will never get any new content. If it's a static collection.
Michelle Eichelberger: Then you don't need to set up a harvest schedule because nothing is going to be added to it. But if it is going to be
Michelle Eichelberger: Intermittently getting new content. You could set up a harvest schedule and it'll just run in the background and you don't have to worry about it. It'll just pull in new new things as they get added
Michelle Eichelberger: Another challenge. You can run into is let's see if we can go back to where that
Michelle Eichelberger: That URL. I told you about.
Let's go.
Michelle Eichelberger: This one here, the base URL. Sometimes this is fiddly, you know, if you make a copy of a collection and you're trying to test it and
Michelle Eichelberger: You try to connect and edit it may tell you that it can't connect. It's a lie.
Michelle Eichelberger: It can connect, for some reason, it just gets weird. So the only way I found to get around that is to copy this line, paste it into notepad and then paste it back into the import profile.
Michelle Eichelberger: It's possible that it's getting some kind of extra space or extra code or something that it doesn't like or it's maybe just a timing issue, and I'm just
Michelle Eichelberger: fooling myself but this you know pasting into Notepad is fixing it, but that that is something that I have seen one playing with this stuff is that sometimes
Michelle Eichelberger: You know, this particular URL gets a little fuzzy. But if you do that, and then hit connect and edit. Again, it should work. The next time. So, so I'm going to zip forward again.
Michelle Eichelberger: Okay. And then again, if you run into any problems, I would either post in base camp and see if anyone else has seen the same issue or submit a Salesforce case I have gotten some help from X Leber's on these import profiles. So that could be a good option for you.
Michelle Eichelberger: So what I'm going to do is pull up the chat and see if there's any questions. The other thing we can do is if you do have questions, we can go out into a live demo environment and look around a little bit. So it's really up to you.
Michelle Eichelberger: However, you would like to move forward. Okay. So Jen has a question. Does it end up in a digital collection. I don't think so.
Michelle Eichelberger: And that's a good question because I just started learning more about digital collections and I there's a way you can set up the space to be harvested that way. But this import profile discovery import profile is not that
Michelle Eichelberger: So, good question. It does not Yvonne has been doing some work with like with digital collections as well. So we're hoping to get an FAQ up soon about that.
Michelle Eichelberger: And I'm trying to get some more information about that.
Michelle Eichelberger: One of the things we're really trying to get working better is that Sunni press collection from 2003 to 2006 I'm working with x Libra is to try and make it a CZ collection.
Michelle Eichelberger: Because, again, the proxy has been challenging when you bring it in as an important profile you can bring the records in they work beautifully.
Michelle Eichelberger: And if you're on campus. They'll work fine to get to them because your IP addresses are registered with the space. But if you're off campus, there's
Michelle Eichelberger: It's very challenging to get that proxy prefix into the linking because you are setting up that I'm the you know the the linking parameter and it's funky code and I could not get it to work. But, um,
Michelle Eichelberger: So anyway, digital collection might be a way to go for that Sunni press content, it might be easier to get a proxy on that.
jennifer.parker: Thanks, Michelle.
Michelle Eichelberger: Yeah, you're welcome. Any other questions, anything anybody wants to see
stop sharing
jennifer.parker: I am really curious about the digital collection aspect when you guys get that far.
Michelle Eichelberger: Yeah, I can get it to get into cream. I've been working in Empire sandbox, but I can't get the
Michelle Eichelberger: Well, I have not tried very hard, but I haven't been able to actually get the thing to display.
Michelle Eichelberger: I think it's a really good opportunity because especially now with the digital viewer being in primo there might even be a way to, like, get it sucked into primo and then the document will show right there in your search results which be really cool. So
Michelle Eichelberger: There's a lot of things that are happening all the time. And we're just trying to stay on top of them. So if anybody else plays around with this and gets it to work, then definitely share it on base camp, because it's it's complicated, but I think powerful and there's a lot of opportunities.
Michelle Eichelberger: Anything else, has anybody done this with good success that you want to talk about
Michelle Eichelberger: I will say that
Michelle Eichelberger: We had a case recently where somebody had pulled in their A to Z database list from live, guys. And that was actually causing some problems in primo so I don't know if I would use it for that you could pull in your lip guides, if you wanted. You know, if you had
Michelle Eichelberger: Course Guides that you want to just share and primo and make searchable. BUT YOU KNOW IF YOU'RE A to Z list. I don't know that that's an ideal way to get that content in I would recommend using resource recommender instead of trying to pull in live guide. A to Z content.
Michelle Eichelberger: Alright, well, if there are no questions. I really appreciate you taking the time to join me today, and I hope that this was helpful and I'll get the recordings posted by the end of the day.
Thanks, everybody.